00000001:02000400:3.0F:1790391127.704679:0:3298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1790391142.408966:0:3514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1790391144.331854:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 651 MB/s 00000001:01000000:3.0:1790391144.581966:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 855 MB/s 00000001:01000000:3.0:1790391144.832000:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8435 MB/s 00000020:02000000:1.0F:1790391145.482009:0:3606:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_4_g2dccaf1 00000400:02000000:2.0:1790391146.238299:0:3621:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.128@tcp [8/256/0/180] 00008000:02000000:0.0:1790391150.269151:0:3771:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1790391212.769574:0:5739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790391226.191079:0:6489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790391226.191097:0:6489:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1790391226.191099:0:6489:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790391226.191237:0:6489:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009a5dc3d2 00000080:02000400:2.0:1790391226.191248:0:6489:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1790391226.198729:0:6489:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1790391226.199708:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790391226.199736:0:6489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a95434dc) 00000020:00000080:2.0:1790391226.199760:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790391226.262726:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790391226.262813:0:6489:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1790391226.298090:0:6489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790391226.298331:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790391226.298340:0:6489:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790391226.298959:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e0a5c 00000020:01000004:2.0:1790391226.298968:0:6489:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1790391226.298973:0:6489:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790391226.298979:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009a5dc3d2 from MGS 00000020:01000004:2.0:1790391226.298983:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790391226.298994:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a78ff7a1) 00000020:00000080:2.0:1790391226.299005:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790391226.299141:0:6489:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009a5dc3d2 from MGS, refs=2 00080000:01000000:2.0:1790391226.299147:0:6489:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790391226.299152:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e0a6a 00000100:00100000:2.0:1790391226.299276:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790391226.300644:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790391226.300656:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790391226.301702:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790391226.301712:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790391226.303342:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391226.303958:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790391226.303966:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790391226.308412:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790391226.308429:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790391226.310179:0:6489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790391226.310192:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790391226.312475:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391226.312481:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391226.312483:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391226.315657:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391226.315665:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391226.315668:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391226.316626:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790391226.325237:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1790391226.566670:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3187 MB/s 00000001:01000000:3.0:1790391226.816382:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4147 MB/s 00000001:01000000:3.0:1790391227.066382:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 451 MB/s 00000001:01000000:2.0:1790391227.322080:0:6489:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 519 MB/s 00080000:10000000:2.0:1790391227.332263:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:2.0:1790391227.341635:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790391227.362170:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1790391227.372719:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790391227.376096:0:6489:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790391227.376185:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1790391227.377315:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790391227.377352:0:6489:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790391227.378080:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391227.378265:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790391227.378273:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790391227.379329:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790391227.379339:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790391227.380361:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790391227.380372:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790391227.381115:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790391227.381140:0:6489:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.128@tcp' 00000020:01000004:1.0:1790391227.381142:0:6489:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790391227.381195:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.128@tcp (typ=mgc) 00000020:00000080:1.0:1790391227.381215:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.128@tcp (0000000058ee109a) 00000020:00000080:1.0:1790391227.381235:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790391227.381349:0:6489:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003022a11f@MGC192.168.202.128@tcp: add connection 192.168.202.128@tcp at head 00010000:00010000:1.0:1790391227.381513:0:6489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.128@tcp-0 is initialized 00000040:01000000:1.0:1790391227.381529:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790391227.383223:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1790391227.384390:0:6509:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790391227.384464:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.128@tcp (uuid c8c24317-3e12-4efa-bd41-8d3f5086c0ea) 00000020:00000080:2.0:1790391227.384499:0:6489:0:(genops.c:1385:class_connect()) connect: client c8c24317-3e12-4efa-bd41-8d3f5086c0ea, cookie 0x2b1b7949f13e0a78 00000100:00080000:2.0:1790391227.384516:0:6489:0:(import.c:545:import_select_connection()) MGC192.168.202.128@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391227.384522:0:6489:0:(import.c:665:import_select_connection()) MGC192.168.202.128@tcp: import 000000003022a11f using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391227.384572:0:6489:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006cde06c4 x1877361186308224/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391227.384595:0:6489:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS 00000020:01000004:2.0:1790391227.384612:0:6489:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790391227.384617:0:6489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790391227.384632:0:6489:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000063dbe8c1) 00000020:00000080:2.0:1790391227.384643:0:6489:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790391227.386364:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cde06c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3636:1877361186308224:0@lo:250: 00000100:00100000:3.0:1790391227.386492:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391227.389701:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186308224 00000100:00100000:0.0:1790391227.389723:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186308224 00000100:00100000:0.0:1790391227.389783:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391227.389792:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5925df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1877361186308224:12345-0@lo:250: 00010000:00080000:0.0:1790391227.389823:0:6505:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c8c24317-3e12-4efa-bd41-8d3f5086c0ea@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:0.0:1790391227.389852:0:6505:0:(genops.c:1385:class_connect()) connect: client c8c24317-3e12-4efa-bd41-8d3f5086c0ea, cookie 0x2b1b7949f13e0a86 00000100:00080000:0.0:1790391227.390052:0:6505:0:(import.c:65:import_set_state_nolock()) 000000008839027d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391227.390165:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5925df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:3636:x1877361186308224:12345-0@lo:250: Request processed in 372us (3680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391227.390174:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391227.390223:0:3636:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.128@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790391227.390234:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.128@tcp: connect to target with instance 0 00000100:00080000:0.0:1790391227.390243:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.128@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790391227.390248:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790391227.390251:0:3636:0:(import.c:65:import_set_state_nolock()) 000000003022a11f MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790391227.390254:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790391227.390264:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790391227.390269:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cde06c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3636:1877361186308224:0@lo:250: 00000100:00100000:2.0:1790391227.407084:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391227.407319:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790391227.407326:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790391227.412327:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790391227.412340:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790391227.415297:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790391227.415311:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790391227.416208:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391227.416566:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790391227.416573:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790391227.417689:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790391227.417699:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790391227.475504:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391227.475785:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790391227.475792:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790391227.477190:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790391227.477202:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790391227.478095:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391227.478265:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790391227.478271:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790391227.478796:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790391227.478802:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790391227.479569:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391227.479811:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790391227.479817:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790391227.480412:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790391227.480419:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790391227.481244:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391227.481426:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790391227.481432:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790391227.489781:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790391227.489809:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790391227.510338:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391227.510560:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790391227.510567:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1790391227.516865:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790391227.517021:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1790391227.522766:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790391227.522780:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790391227.523870:0:6489:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790391227.523955:0:6489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1790391227.523963:0:6489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790391227.524092:0:6489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790391227.524136:0:6489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.128@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1790391227.524141:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790391227.524143:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391227.524144:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391227.524145:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391227.524147:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391227.524148:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391227.524149:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391227.524150:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391227.524152:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790391227.524153:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790391227.524154:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391227.524156:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790391227.524159:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1790391227.524161:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790391227.524162:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790391227.524163:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391227.524164:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391227.524165:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391227.524166:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391227.524167:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790391227.524168:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790391227.524169:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790391227.524170:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790391227.524171:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391227.524172:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790391227.524211:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790391227.524229:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000091764f54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308352:0@lo:253: 00000100:00100000:0.0:1790391227.524305:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391227.524356:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8e1a7b3 going to sleep for 11 seconds 00000100:00100000:3.0:1790391227.524711:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186308352 00000100:00100000:3.0:1790391227.524720:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186308352 00000100:00100000:3.0:1790391227.524782:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391227.524791:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c471ceab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:6489:x1877361186308352:12345-0@lo:253: 20000000:01000000:3.0:1790391227.524837:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790391227.524841:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1790391227.525592:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790391227.525651:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1790391227.525994:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391227.527339:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1790391227.527552:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790391227.527557:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1790391227.527563:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1790391227.527566:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1790391227.527577:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1790391227.527780:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391227.527973:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1790391227.527987:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790391227.528004:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1790391227.528035:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1790391227.528048:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1790391227.528100:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1790391227.528118:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1790391227.528133:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1790391227.528138:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1790391227.528150:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1790391227.528155:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1790391227.528166:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1790391227.528179:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1790391227.528205:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790391227.528210:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1790391227.528216:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391227.528327:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1790391227.528336:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790391227.528351:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1790391227.528364:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1790391227.528377:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1790391227.528384:0:6507:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1790391227.528409:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1790391227.528416:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790391227.528427:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1790391227.528439:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1790391227.528452:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1790391227.528459:0:6507:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1790391227.528494:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1790391227.528503:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1790391227.528516:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1790391227.528531:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1790391227.528583:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1790391227.528603:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1790391227.528610:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1790391227.536049:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1790391227.536421:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1790391227.536454:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.128@tcp for mdt 20000000:01000000:2.0:1790391227.536456:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.128@tcp (null) (null) (null) 00000040:00080000:2.0:1790391227.536473:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1790391227.536481:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790391227.536494:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1790391227.536500:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.128@tcp (null) (null) 00000040:00080000:2.0:1790391227.536512:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1790391227.536519:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1790391227.536530:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1790391227.536577:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1790391227.536611:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790391227.536614:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790391227.536618:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790391227.536702:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790391227.536705:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790391227.537192:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1790391227.537349:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1790391227.537368:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1790391227.537382:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1790391227.537390:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790391227.537392:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790391227.537986:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1790391227.538253:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1790391227.538274:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1790391227.538286:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1790391227.538296:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391227.538298:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1790391227.538302:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790391227.538304:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1790391227.538309:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1790391227.538314:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1790391227.544872:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1790391227.548245:0:6507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1790391227.555795:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1790391227.555844:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1790391227.555859:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1790391227.555908:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790391227.555945:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.555964:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.555974:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.555980:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.555986:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.555992:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.555998:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009550a154 already unused, calling callback (000000002575b2ae) 00010000:00010000:0.0:1790391227.556001:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.556009:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.556022:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.556029:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.556041:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009550a154/0x2b1b7949f13e0a8d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790391227.556062:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790391227.572029:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c471ceab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:6489:x1877361186308352:12345-0@lo:253: Request processed in 47230us (47715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391227.572048:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391227.572168:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000091764f54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308352:0@lo:253: 10000000:01000000:2.0:1790391227.572186:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790391227.572190:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790391227.572192:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790391227.572193:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391227.572194:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1790391227.572195:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391227.572197:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391227.572197:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790391227.572199:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790391227.572212:0:6489:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790391227.572214:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391227.572215:0:6489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790391227.572234:0:6489:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009a5dc3d2 from lustre-MDT0000 10000000:01000000:2.0:1790391227.572281:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790391227.572285:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790391227.572289:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e52ae8c99c0 10000000:01000000:2.0:1790391227.572293:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391227.572302:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e52ae8c99c0 from 1 10000000:01000000:2.0:1790391227.572306:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790391227.572347:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.572358:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.572367:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391227.572386:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308480:0@lo:101: 00000100:00100000:2.0:1790391227.572422:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.572476:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8e1a7b3 going to sleep for 11 seconds 00000100:00100000:3.0:1790391227.572596:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186308480 00000100:00100000:3.0:1790391227.572604:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186308480 00000100:00100000:3.0:1790391227.572650:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391227.572674:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b5b3843 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:6489:x1877361186308480:12345-0@lo:101: 00010000:00010000:3.0:1790391227.572686:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391227.572699:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f98c48e/0x2b1b7949f13e0a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0a94 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.572732:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f98c48e/0x2b1b7949f13e0a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0a94 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.572743:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f98c48e/0x2b1b7949f13e0a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0a94 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.572753:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f98c48e, rc 0) 00000100:00100000:3.0:1790391227.572792:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b5b3843 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+6:6489:x1877361186308480:12345-0@lo:101: Request processed in 129us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391227.572798:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391227.572817:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308480:0@lo:101: 00010000:00010000:2.0:1790391227.572830:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.572839:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391227.574730:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308608:0@lo:501: 00000100:00100000:2.0:1790391227.574789:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.574839:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8e1a7b3 going to sleep for 11 seconds 00000100:00100000:0.0:1790391227.575560:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186308608 00000100:00100000:0.0:1790391227.575570:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186308608 00000100:00100000:0.0:1790391227.575622:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391227.575630:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c3b3cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+6:6489:x1877361186308608:12345-0@lo:501: 00000100:00100000:0.0:1790391227.575730:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c3b3cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+6:6489:x1877361186308608:12345-0@lo:501: Request processed in 99us (940us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391227.575737:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391227.575858:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308608:0@lo:501: 10000000:01000000:2.0:1790391227.575938:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790391227.575958:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.575968:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391227.575978:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e5289da8000 10000000:01000000:2.0:1790391227.575982:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790391227.575987:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e5289da8000 10000000:01000000:2.0:1790391227.575989:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790391227.575992:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e5289da8000 from 1 10000000:01000000:2.0:1790391227.575995:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790391227.576024:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000890a8bb0/0x2b1b7949f13e0aa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.576031:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000890a8bb0/0x2b1b7949f13e0aa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.576039:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000890a8bb0/0x2b1b7949f13e0aa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391227.576051:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308736:0@lo:101: 00000100:00100000:2.0:1790391227.576080:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.576104:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8e1a7b3 going to sleep for 11 seconds 00000100:00100000:0.0:1790391227.576369:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186308736 00000100:00100000:0.0:1790391227.576374:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186308736 00000100:00100000:0.0:1790391227.576410:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391227.576417:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5a286a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+6:6489:x1877361186308736:12345-0@lo:101: 00010000:00010000:0.0:1790391227.576425:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391227.576438:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009550a154/0x2b1b7949f13e0aa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0aa2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.576459:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009550a154/0x2b1b7949f13e0aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0aa2 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.576468:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009550a154/0x2b1b7949f13e0aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0aa2 expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.576509:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009550a154, rc 0) 00000100:00100000:0.0:1790391227.576549:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5a286a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+7:6489:x1877361186308736:12345-0@lo:101: Request processed in 133us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391227.576555:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391227.576734:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308736:0@lo:101: 00010000:00010000:2.0:1790391227.576748:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000890a8bb0/0x2b1b7949f13e0aa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.576762:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000890a8bb0/0x2b1b7949f13e0aa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391227.576777:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790391227.576790:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000890a8bb0/0x2b1b7949f13e0aa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.576797:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 00000000890a8bb0/0x2b1b7949f13e0aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391227.576802:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790391227.576805:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391227.576810:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e5289da8000 10000000:01000000:2.0:1790391227.576813:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790391227.576815:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790391227.576817:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790391227.576832:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.576837:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.576843:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391227.576853:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308864:0@lo:101: 00000100:00100000:2.0:1790391227.576904:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.576937:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8e1a7b3 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.577025:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186308864 00000100:00100000:1.0:1790391227.577031:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186308864 00000100:00100000:1.0:1790391227.577055:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391227.577061:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb595171 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+7:6489:x1877361186308864:12345-0@lo:101: 00010000:00010000:1.0:1790391227.577067:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391227.577077:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0ab0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.577090:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ab0 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.577103:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ab0 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.577108:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c264268d, rc 0) 00000100:00100000:1.0:1790391227.577158:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb595171 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+8:6489:x1877361186308864:12345-0@lo:101: Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.577164:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391227.577273:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308864:0@lo:101: 00010000:00010000:2.0:1790391227.577283:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.577289:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391227.577339:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308992:0@lo:501: 00000100:00100000:2.0:1790391227.577363:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.577392:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8e1a7b3 going to sleep for 11 seconds 00000100:00100000:3.0:1790391227.577444:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186308992 00000100:00100000:3.0:1790391227.577448:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186308992 00000100:00100000:3.0:1790391227.577480:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391227.577503:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e581013 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+8:6489:x1877361186308992:12345-0@lo:501: 00000100:00100000:3.0:1790391227.577615:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e581013 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:6489:x1877361186308992:12345-0@lo:501: Request processed in 119us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391227.577622:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391227.577795:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186308992:0@lo:501: 00000100:00100000:2.0:1790391227.577821:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186309120:0@lo:503: 00000100:00100000:2.0:1790391227.577859:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.577902:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8e1a7b3 going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.577980:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186309120 00000100:00100000:1.0:1790391227.577986:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186309120 00000100:00100000:1.0:1790391227.578005:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391227.578010:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005824f20b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:6489:x1877361186309120:12345-0@lo:503: 00000100:00100000:1.0:1790391227.578083:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005824f20b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:6489:x1877361186309120:12345-0@lo:503: Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.578089:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391227.578162:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186309120:0@lo:503: 00000100:00100000:1.0:1790391227.578446:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f1e128 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6534:1877361186309248:0@lo:502: 00000100:00100000:1.0:1790391227.578475:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.578515:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000033e3bae0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391227.578648:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186309248 00000100:00100000:2.0:1790391227.578652:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186309248 00000100:00100000:2.0:1790391227.578671:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391227.578675:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bafd5e0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:6534:x1877361186309248:12345-0@lo:502: 00000100:00100000:2.0:1790391227.578748:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bafd5e0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:6534:x1877361186309248:12345-0@lo:502: Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391227.578754:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391227.579093:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f1e128 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6534:1877361186309248:0@lo:502: 00000020:01000000:1.0:1790391227.579118:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391227.579129:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391227.579132:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790391227.579136:0:6534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790391227.579139:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391227.579153:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002bcf305f) 00000020:00000080:1.0:1790391227.579169:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790391227.579175:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790391227.579267:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790391227.579281:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e0ac5 00000020:00000080:1.0:1790391227.579625:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790391227.579631:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391227.579635:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391227.579637:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790391227.579639:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391227.579643:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391227.579644:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790391227.579647:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391227.579655:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001f0336ec) 00000020:00000080:1.0:1790391227.579664:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790391227.579668:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790391227.579669:0:6534:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790391227.579672:0:6534:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790391227.579677:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790391227.579718:0:6534:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009a5dc3d2 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790391227.579730:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001d0cdd49) 00000020:00000080:1.0:1790391227.579737:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790391227.579815:0:6534:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790391227.579821:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e0ada 00000020:00000080:1.0:1790391227.579965:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790391227.579972:0:6534:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790391227.579977:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2b1b7949f13e0ae1 00080000:01000000:1.0:1790391227.579982:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790391227.579985:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e0ae8 00080000:10000000:1.0:1790391227.580477:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1790391227.581118:0:6534:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1790391227.592120:0:6534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1790391227.691280:0:6534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1790391227.691727:0:6534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1790391227.694386:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1790391227.694811:0:6534:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790391227.699649:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000004e8e233) 00000020:00000080:1.0:1790391227.699677:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790391227.699770:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790391227.699777:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e0af6 00000020:00000080:2.0:1790391227.702487:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1790391227.703237:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1790391227.706320:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1790391227.708340:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1790391227.713441:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1790391227.716612:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1790391227.720150:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1790391227.722159:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2b1b7949f13e0afd 00000020:00000080:3.0:1790391227.722474:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790391227.722487:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391227.722503:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391227.722505:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790391227.722509:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391227.722514:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391227.722515:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790391227.722518:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790391227.722519:0:6534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790391227.722521:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391227.722524:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391227.722525:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790391227.722527:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391227.722531:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391227.722532:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790391227.722536:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790391227.722571:0:6534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1790391227.722638:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ec07a76 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6534:1877361186309376:0@lo:502: 00000100:00100000:3.0:1790391227.722710:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391227.722765:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4e017d2 going to sleep for 11 seconds 00000100:00100000:2.0:1790391227.722866:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186309376 00000100:00100000:2.0:1790391227.722908:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186309376 00000100:00100000:2.0:1790391227.722967:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391227.722975:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d6e59d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:6534:x1877361186309376:12345-0@lo:502: 00000100:00100000:2.0:1790391227.723093:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d6e59d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:6534:x1877361186309376:12345-0@lo:502: Request processed in 118us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391227.723101:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790391227.723201:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ec07a76 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6534:1877361186309376:0@lo:502: 00000020:01000000:1.0:1790391227.723227:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391227.723231:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391227.723233:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1790391227.723237:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1790391227.723466:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1790391227.723489:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790391227.723568:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.723580:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391227.723588:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5289da8000 from 1 10000000:01000000:2.0:1790391227.723591:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391227.723619:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.723627:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.723636:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391227.723648:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186309504:0@lo:101: 00000100:00100000:2.0:1790391227.723677:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.723708:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b56ee6ab going to sleep for 11 seconds 00000100:00100000:1.0:1790391227.723753:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186309504 00000100:00100000:1.0:1790391227.723757:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186309504 00000100:00100000:1.0:1790391227.723788:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391227.723794:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093663dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:6489:x1877361186309504:12345-0@lo:101: 00010000:00010000:1.0:1790391227.723802:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391227.723815:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0b0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0b04 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.723836:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b04 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.723846:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b04 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.723854:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007bae652f, rc 0) 00000100:00100000:1.0:1790391227.723905:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093663dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+10:6489:x1877361186309504:12345-0@lo:101: Request processed in 112us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391227.723911:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391227.724011:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186309504:0@lo:101: 00010000:00010000:2.0:1790391227.724034:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.724043:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391227.724752:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186309632:0@lo:256: 00000100:00100000:2.0:1790391227.724798:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.724908:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b56ee6ab going to sleep for 11 seconds 00000100:00100000:3.0:1790391227.725067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186309632 00000100:00100000:3.0:1790391227.725074:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186309632 00000100:00100000:3.0:1790391227.725118:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391227.725125:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000068cd10c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+10:6489:x1877361186309632:12345-0@lo:256: 20000000:01000000:3.0:1790391227.725146:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790391227.725152:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790391227.725223:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000068cd10c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+10:6489:x1877361186309632:12345-0@lo:256: Request processed in 99us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391227.725229:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790391227.725361:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186309632:0@lo:256: 10000000:01000000:2.0:1790391227.726481:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790391227.726511:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.726522:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391227.726529:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5289da8000 from 1 10000000:01000000:2.0:1790391227.726532:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391227.726567:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.726573:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.726583:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391227.726597:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186309760:0@lo:101: 00000100:00100000:2.0:1790391227.727384:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.727539:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b56ee6ab going to sleep for 11 seconds 00000100:00100000:0.0:1790391227.727839:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186309760 00000100:00100000:0.0:1790391227.727847:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186309760 00000100:00100000:0.0:1790391227.728025:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391227.728034:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056f35508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+10:6489:x1877361186309760:12345-0@lo:101: 00010000:00010000:0.0:1790391227.728049:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391227.728067:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2f5bb09/0x2b1b7949f13e0b19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0b12 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.728093:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2f5bb09/0x2b1b7949f13e0b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b12 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.728104:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2f5bb09/0x2b1b7949f13e0b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b12 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.728112:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2f5bb09, rc 0) 00000100:00100000:0.0:1790391227.728232:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056f35508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:6489:x1877361186309760:12345-0@lo:101: Request processed in 199us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391227.728239:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391227.728429:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e870bf6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186309760:0@lo:101: 00010000:00010000:3.0:1790391227.728456:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.728465:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391227.728609:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071ff102a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186309888:0@lo:501: 00000100:00100000:3.0:1790391227.728641:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391227.728704:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e47e37ae going to sleep for 11 seconds 00000100:00100000:2.0:1790391227.728738:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186309888 00000100:00100000:2.0:1790391227.728744:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186309888 00000100:00100000:2.0:1790391227.728804:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391227.728810:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a3c3e09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:6489:x1877361186309888:12345-0@lo:501: 00000100:00100000:2.0:1790391227.729005:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a3c3e09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:6489:x1877361186309888:12345-0@lo:501: Request processed in 195us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391227.729012:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391227.729080:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071ff102a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186309888:0@lo:501: 00000100:00100000:3.0:1790391227.729108:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071ff102a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186310016:0@lo:503: 00000100:00100000:3.0:1790391227.729145:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391227.729290:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e47e37ae going to sleep for 11 seconds 00000100:00100000:0.0:1790391227.729348:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186310016 00000100:00100000:0.0:1790391227.729352:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186310016 00000100:00100000:0.0:1790391227.729373:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790391227.729379:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066394683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:6489:x1877361186310016:12345-0@lo:503: 00000040:00080000:0.0:1790391227.729411:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790391227.729461:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066394683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:6489:x1877361186310016:12345-0@lo:503: Request processed in 82us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391227.729467:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391227.729590:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071ff102a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186310016:0@lo:503: 00000040:00080000:3.0:1790391227.730719:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1790391227.731131:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790391227.731154:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391227.731205:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.731217:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391227.731272:0:6489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790391227.731274:0:6489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e5289da8000 10000000:01000000:2.0:1790391227.731277:0:6489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e5289da8000 10000000:01000000:2.0:1790391227.731281:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391227.731287:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5289da8000 from 1 10000000:01000000:2.0:1790391227.731289:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790391227.731323:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.731330:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.731340:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391227.731366:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002bc257ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186310144:0@lo:101: 00000100:00100000:2.0:1790391227.731418:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.731459:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8e1a7b3 going to sleep for 11 seconds 00000100:00100000:0.0:1790391227.731525:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186310144 00000100:00100000:0.0:1790391227.731533:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186310144 00000100:00100000:0.0:1790391227.731577:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391227.731585:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a51af254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:6489:x1877361186310144:12345-0@lo:101: 00010000:00010000:0.0:1790391227.731596:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391227.731608:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b83df72c/0x2b1b7949f13e0b27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0b20 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.731633:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b83df72c/0x2b1b7949f13e0b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b20 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.731644:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b83df72c/0x2b1b7949f13e0b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b20 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391227.731653:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b83df72c, rc 0) 00000100:00100000:0.0:1790391227.731705:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a51af254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6489:x1877361186310144:12345-0@lo:101: Request processed in 121us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391227.731712:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391227.731937:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002bc257ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186310144:0@lo:101: 00010000:00010000:1.0:1790391227.731951:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.731969:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391227.732026:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f1e128 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186310272:0@lo:501: 00000100:00100000:1.0:1790391227.732053:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.732070:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf2b07d1 going to sleep for 11 seconds 00000100:00100000:0.0:1790391227.732154:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186310272 00000100:00100000:0.0:1790391227.732159:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186310272 00000100:00100000:0.0:1790391227.732193:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790391227.732199:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031977c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6489:x1877361186310272:12345-0@lo:501: 00000100:00100000:0.0:1790391227.732308:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031977c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6489:x1877361186310272:12345-0@lo:501: Request processed in 109us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391227.732315:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391227.732404:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f1e128 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186310272:0@lo:501: 00000100:00100000:1.0:1790391227.732431:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1f1e128 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186310400:0@lo:503: 00000100:00100000:1.0:1790391227.732466:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.732487:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf2b07d1 going to sleep for 11 seconds 00000100:00100000:2.0:1790391227.732579:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186310400 00000100:00100000:2.0:1790391227.732584:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186310400 00000100:00100000:2.0:1790391227.732616:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790391227.732621:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065250a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6489:x1877361186310400:12345-0@lo:503: 00000100:00100000:2.0:1790391227.732856:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065250a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6489:x1877361186310400:12345-0@lo:503: Request processed in 234us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391227.732862:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391227.733032:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1f1e128 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186310400:0@lo:503: 00000100:00100000:2.0:1790391227.733373:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022877b14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6539:1877361186310528:0@lo:502: 00000100:00100000:2.0:1790391227.733414:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.733482:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012797bbe going to sleep for 11 seconds 00000100:00100000:0.0:1790391227.733576:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186310528 00000100:00100000:0.0:1790391227.733587:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186310528 00000100:00100000:0.0:1790391227.733652:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790391227.733660:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095fbdfbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6539:x1877361186310528:12345-0@lo:502: 00000100:00100000:0.0:1790391227.733760:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095fbdfbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6539:x1877361186310528:12345-0@lo:502: Request processed in 100us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391227.733766:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790391227.733825:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022877b14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6539:1877361186310528:0@lo:502: 00000020:01000004:2.0:1790391227.733929:0:6539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790391227.733945:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000010a9fe68) 00000020:00000080:2.0:1790391227.733965:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1790391227.734052:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009a5dc3d2 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790391227.734056:0:6539:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009a5dc3d2 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790391227.734059:0:6539:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009a5dc3d2 4 00010000:00080000:2.0:1790391227.734094:0:6539:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000aa328dc5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391227.735611:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1790391227.735833:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790391227.735873:0:6539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790391227.735913:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2b1b7949f13e0b35 00000100:00080000:2.0:1790391227.735933:0:6539:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391227.735945:0:6539:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000aa328dc5 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391227.735981:0:6539:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000022877b14 x1877361186310656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391227.736002:0:6539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790391227.736970:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022877b14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186310656:0@lo:38: 00000100:00100000:1.0:1790391227.737040:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.737614:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186310656 00000100:00100000:2.0:1790391227.737623:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186310656 00000100:00100000:2.0:1790391227.737670:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391227.737677:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1f1e128 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186310656:12345-0@lo:38: 00000100:00100000:2.0:1790391227.737743:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1f1e128 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186310656:12345-0@lo:38: Request processed in 65us (703us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790391227.737750:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391227.737822:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391227.737831:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000aa328dc5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391227.737836:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790391227.737839:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022877b14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186310656:0@lo:38: 00000100:00100000:2.0:1790391227.739510:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6539:1877361186310784:0@lo:502: 00000100:00100000:2.0:1790391227.739581:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.739624:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 00000000138bac0e going to sleep for 11 seconds 00000100:00100000:0.0:1790391227.739740:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186310784 00000100:00100000:0.0:1790391227.739748:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186310784 00000100:00100000:0.0:1790391227.739795:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391227.739803:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c1d9e09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6539:x1877361186310784:12345-0@lo:502: 00000100:00100000:0.0:1790391227.739950:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c1d9e09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6539:x1877361186310784:12345-0@lo:502: Request processed in 148us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391227.739958:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790391227.740150:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6539:1877361186310784:0@lo:502: 00000040:00080000:2.0:1790391227.740178:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1790391227.740296:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1790391227.740316:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790391227.740339:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.740350:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790391227.740408:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790391227.740411:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391227.740413:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391227.740414:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391227.740415:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391227.740417:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391227.740418:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391227.740419:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391227.740421:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790391227.740422:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790391227.740423:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391227.740424:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790391227.740429:0:6489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1790391227.740431:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790391227.740433:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391227.740434:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391227.740435:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391227.740436:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391227.740437:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391227.740438:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391227.740439:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391227.740440:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790391227.740441:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790391227.740442:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391227.740443:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790391227.740460:0:6489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790391227.740469:0:6489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006f61dd0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186310912:0@lo:253: 00000100:00100000:1.0:1790391227.740519:0:6489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391227.740548:0:6489:0:(client.c:2716:ptlrpc_set_wait()) set 000000008595fbd6 going to sleep for 11 seconds 00000100:00100000:0.0:1790391227.740592:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186310912 00000100:00100000:0.0:1790391227.740597:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186310912 00000100:00100000:0.0:1790391227.740634:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391227.740641:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e28bae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6489:x1877361186310912:12345-0@lo:253: 20000000:01000000:0.0:1790391227.740660:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790391227.740674:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790391227.746082:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790391227.746108:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790391227.746410:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e28bae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6489:x1877361186310912:12345-0@lo:253: Request processed in 5766us (5888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391227.746424:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790391227.746544:0:6489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006f61dd0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6489:1877361186310912:0@lo:253: 10000000:01000000:1.0:1790391227.746559:0:6489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790391227.746562:0:6489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790391227.746564:0:6489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391227.746565:0:6489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391227.746566:0:6489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391227.746576:0:6489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391227.746578:0:6489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391227.746579:0:6489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391227.746580:0:6489:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391227.746582:0:6489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790391227.746583:0:6489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790391227.746584:0:6489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391227.746585:0:6489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790391227.746601:0:6489:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1790391227.750612:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790391227.750623:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790391227.750647:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.750667:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b04 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.750674:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.750718:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0b04 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.750749:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0b0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b04 expref: 11 pid: 6507 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391227.750762:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186311040:0@lo:104: 00000100:00100000:2.0:1790391227.750829:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391227.750900:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 00000000138bac0e going to sleep for 11 seconds 00000100:00100000:2.0:1790391227.750943:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186311040 00000100:00100000:2.0:1790391227.750950:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186311040 00000100:00100000:2.0:1790391227.751004:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391227.751013:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a448a152 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6528:x1877361186311040:12345-0@lo:104: 00010000:00010000:2.0:1790391227.751026:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391227.751087:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391227.751093:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a448a152 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6528:x1877361186311040:12345-0@lo:104: Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391227.751099:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391227.751137:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186311040:0@lo:104: 00010000:00010000:2.0:1790391227.751156:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.752019:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391227.752028:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.752036:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007d37b478 already unused, calling callback (000000000b92e0f5) 10000000:00010000:1.0:1790391227.752039:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.752047:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391227.752053:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391227.752058:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391227.752138:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.752145:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391227.752168:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.752174:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: 000000007d37b478/0x2b1b7949f13e0b04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b0b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391227.752205:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391227.752206:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391227.752208:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1790391227.753182:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1790391227.753358:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1790391227.753732:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1790391227.754120:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006f61dd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186311168:0@lo:103: 00000100:00100000:0.0:1790391227.754186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391227.754340:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186311168 00000100:00100000:3.0:1790391227.754350:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186311168 00010000:00010000:3.0:1790391227.754382:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0b0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b04 expref: 12 pid: 6507 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391227.754425:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391227.754433:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000796caa50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:3638:x1877361186311168:12345-0@lo:103: 00010000:00010000:3.0:1790391227.754447:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391227.754452:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0b0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b04 expref: 12 pid: 6507 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754465:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b04 expref: 12 pid: 6507 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754490:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0b0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0b04 expref: 12 pid: 6507 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754519:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754528:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790391227.754543:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003920586s 00010000:00010000:3.0:1790391227.754547:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754553:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754558:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754564:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754568:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a2f596a1 already unused, calling callback (000000002575b2ae) 00010000:00010000:3.0:1790391227.754572:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754579:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754597:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754618:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391227.754653:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000796caa50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:3638:x1877361186311168:12345-0@lo:103: Request processed in 222us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391227.754660:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790391227.754687:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754694:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391227.754700:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a2f596a1/0x2b1b7949f13e0b3c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1790391227.754949:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1790391227.755213:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1790391227.755354:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1790391227.755512:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006f61dd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186311168:0@lo:103: 00080000:10000000:1.0:1790391227.756339:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1790391227.756585:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1790391227.756802:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1790391227.757348:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1790391227.757705:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1790391227.757872:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1790391227.762018:0:6489:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1790391227.770323:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1790391227.771081:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790391227.772495:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790391227.772600:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790391227.773261:0:6489:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000020:00080000:1.0:1790391227.773438:0:6544:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1790391227.773442:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1790391227.773490:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790391227.773659:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391227.776302:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391227.777679:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790391227.780859:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790391227.780981:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790391227.780986:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1790391227.781740:0:6489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790391227.782024:0:6489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790391227.782295:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790391227.782598:0:6489:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1790391227.784229:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790391227.784682:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790391227.785141:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790391227.785363:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790391227.785628:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1790391227.785750:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1790391227.786128:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1790391227.786263:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1790391227.786405:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1790391227.786704:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1790391227.787156:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1790391227.787310:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1790391227.787425:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1790391227.787629:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1790391227.787857:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1790391227.788215:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1790391227.788608:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1790391227.788768:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1790391227.789047:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790391227.789174:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790391227.789308:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790391227.789440:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790391227.789684:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790391227.789868:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790391227.790188:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790391227.790350:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790391227.790480:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790391227.790699:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790391227.791037:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790391227.791196:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790391227.791347:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790391227.791486:0:6489:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1790391227.791859:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1790391227.795208:0:6489:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790391227.795251:0:6489:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab84019d7988 00100000:10000000:0.0:1790391227.795260:0:6489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790391227.795983:0:6489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790391227.796004:0:6489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790391227.796023:0:6489:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1790391227.796041:0:6489:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790391227.796846:0:6489:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391227.797121:0:6489:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1790391228.360218:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391229.384075:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391230.409787:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391231.440706:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391232.456558:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391232.963139:0:6790:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1790391233.032107:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790391233.032118:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790391233.032121:0:37:0:(import.c:65:import_set_state_nolock()) 00000000aa328dc5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391233.032135:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000aa328dc5 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391233.032160:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b415e831 x1877361186311424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391233.032200:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b415e831 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186311424:0@lo:38: 00000100:00100000:3.0:1790391233.032277:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391233.032508:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000071ff102a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186311296:0@lo:400: 00000100:00100000:1.0:1790391233.032545:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391233.033228:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186311424 00000100:00100000:1.0:1790391233.033240:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186311424 00000100:00100000:1.0:1790391233.033280:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391233.033289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e6be452 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186311424:12345-0@lo:38: 00010000:00080000:1.0:1790391233.033330:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:1.0:1790391233.033649:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2b1b7949f13e0b43 00000004:00100000:1.0:1790391233.033692:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790391233.033842:0:6514:0:(import.c:65:import_set_state_nolock()) 00000000cf7ae249 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391233.035572:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e6be452 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1877361186311424:12345-0@lo:38: Request processed in 2266us (3278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391233.035588:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391233.035639:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186311296 00000100:00100000:1.0:1790391233.035650:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186311296 00000100:00100000:1.0:1790391233.035699:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790391233.035708:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfaafca9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:3639:x1877361186311296:12345-0@lo:400: 00000100:00100000:1.0:1790391233.035765:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfaafca9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:3639:x1877361186311296:12345-0@lo:400: Request processed in 59us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391233.035771:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790391233.035833:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000071ff102a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186311296:0@lo:400: 00010000:00080000:3.0:1790391233.039801:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b415e831 x1877361186311424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790391233.039827:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790391233.039835:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790391233.039840:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790391233.039843:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000aa328dc5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790391233.039850:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b415e831 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186311424:0@lo:38: 00010000:00010000:1.0:1790391233.480192:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790391234.052148:0:6842:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391234.052320:0:6842:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790391234.504050:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790391234.567968:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790391234.567979:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5289da8000 from 3 10000000:01000000:2.0:1790391234.567985:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391234.568038:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391234.568050:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391234.568063:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391234.568088:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186311552:0@lo:101: 00000100:00100000:2.0:1790391234.568161:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391234.568221:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000996a6480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391234.568278:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186311552 00000100:00100000:3.0:1790391234.568286:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186311552 00000100:00100000:3.0:1790391234.568353:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790391234.568362:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032ffbcf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:6509:x1877361186311552:12345-0@lo:101: 00010000:00010000:3.0:1790391234.568375:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391234.568389:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098169a9f/0x2b1b7949f13e0b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0b4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391234.568423:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098169a9f/0x2b1b7949f13e0b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b4a expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391234.568445:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098169a9f/0x2b1b7949f13e0b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b4a expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391234.568457:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098169a9f, rc 0) 00000100:00100000:3.0:1790391234.568503:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032ffbcf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6509:x1877361186311552:12345-0@lo:101: Request processed in 143us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391234.568510:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391234.568910:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186311552:0@lo:101: 00010000:00010000:2.0:1790391234.568927:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391234.568937:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391234.568989:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186311680:0@lo:256: 00000100:00100000:2.0:1790391234.569020:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391234.569036:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000996a6480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391234.569092:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186311680 00000100:00100000:1.0:1790391234.569097:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186311680 00000100:00100000:1.0:1790391234.569134:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391234.569140:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066f13b7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6509:x1877361186311680:12345-0@lo:256: 20000000:01000000:1.0:1790391234.569154:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790391234.569172:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790391234.569175:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1790391234.569250:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066f13b7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:6509:x1877361186311680:12345-0@lo:256: Request processed in 111us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391234.569257:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790391234.569318:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186311680:0@lo:256: 10000000:01000000:2.0:1790391234.569379:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790391234.569386:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391234.569393:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391235.529617:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391236.553036:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790391236.744550:0:6944:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391236.744720:0:6944:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790391237.580622:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391238.152162:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391238.152270:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391238.152283:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a20d30c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186311808:0@lo:400: 00000100:00100000:1.0:1790391238.152360:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391238.152436:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186311808 00000100:00100000:1.0:1790391238.152444:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186311808 00000100:00100000:1.0:1790391238.152490:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391238.152498:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031dff997 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:3639:x1877361186311808:12345-0@lo:400: 00000100:00100000:1.0:1790391238.152542:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031dff997 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:3639:x1877361186311808:12345-0@lo:400: Request processed in 45us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391238.152548:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391238.152589:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a20d30c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186311808:0@lo:400: 00000100:00100000:0.0:1790391238.153074:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186311936:0@lo:400: 00000100:00100000:1.0:1790391238.153217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391238.153402:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186311936 00000100:00100000:2.0:1790391238.153408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186311936 00000100:00100000:2.0:1790391238.153446:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391238.153453:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000188f3fb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186311936:12345-0@lo:400: 00000100:00100000:2.0:1790391238.153501:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000188f3fb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186311936:12345-0@lo:400: Request processed in 49us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391238.153507:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790391238.153962:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b8c7823c x1877361186311936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391238.153977:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186311936:0@lo:400: 00010000:00010000:3.0:1790391238.600039:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391239.635778:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391240.660082:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391241.673109:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391242.701151:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391243.290000:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0bd1baa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186312064:0@lo:400: 00000100:00100000:1.0:1790391243.290069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391243.290721:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186312192:0@lo:400: 00000100:00100000:1.0:1790391243.290760:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391243.291516:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186312192 00000100:00100000:1.0:1790391243.291526:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186312192 00000100:00100000:1.0:1790391243.291575:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391243.291585:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007647f73a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186312192:12345-0@lo:400: 00000100:00100000:1.0:1790391243.291644:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007647f73a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186312192:12345-0@lo:400: Request processed in 61us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391243.291653:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790391243.291698:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e2880dd3 x1877361186312192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391243.291711:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186312192:0@lo:400: 00000100:00100000:2.0:1790391243.306975:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186312064 00000100:00100000:2.0:1790391243.306989:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186312064 00000100:00100000:2.0:1790391243.307050:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790391243.307058:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041a787bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:3638:x1877361186312064:12345-0@lo:400: 00000100:00100000:2.0:1790391243.307142:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041a787bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:3638:x1877361186312064:12345-0@lo:400: Request processed in 85us (17073us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391243.307150:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790391243.307226:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0bd1baa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186312064:0@lo:400: 00010000:00010000:1.0:1790391243.721621:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391244.749586:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391245.768066:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391246.799822:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790391247.177008:0:7442:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790391247.177013:0:7442:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1790391247.177015:0:7442:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790391247.177123:0:7442:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009f607e4c 00000020:01000004:0.0:1790391247.177140:0:7442:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1790391247.177152:0:7442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790391247.177178:0:7442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000fe70119b) 00000020:00000080:0.0:1790391247.177197:0:7442:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790391247.256754:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1790391247.256813:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1790391247.287499:0:7442:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790391247.287727:0:7442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1790391247.287746:0:7442:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790391247.287757:0:7442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e0b5f 00000020:01000004:3.0:1790391247.287763:0:7442:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790391247.287784:0:7442:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.128@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790391247.287788:0:7442:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790391247.287793:0:7442:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1790391247.287818:0:7442:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1790391247.287821:0:7442:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1790391247.307403:0:7442:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790391247.307443:0:7442:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.128@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1790391247.307451:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790391247.307453:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790391247.307454:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391247.307455:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391247.307456:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391247.307457:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391247.307458:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790391247.307460:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391247.307461:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391247.307462:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391247.307463:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391247.307467:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1790391247.307469:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391247.307470:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790391247.307471:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391247.307472:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391247.307473:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391247.307474:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391247.307475:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790391247.307476:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391247.307477:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391247.307478:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391247.307479:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391247.307509:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790391247.307525:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186312320:0@lo:253: 00000100:00100000:2.0:1790391247.307594:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391247.307643:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044436f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391247.307815:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186312320 00000100:00100000:1.0:1790391247.307826:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186312320 00000100:00100000:1.0:1790391247.307907:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391247.307916:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e7e7fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186312320:12345-0@lo:253: 20000000:01000000:1.0:1790391247.307944:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790391247.307948:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1790391247.307953:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1790391247.307955:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1790391247.307990:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1790391247.308155:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391247.308288:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1790391247.308301:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790391247.308333:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1790391247.308351:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1790391247.308364:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1790391247.308412:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1790391247.308420:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1790391247.308430:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1790391247.308436:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1790391247.308446:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1790391247.308450:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1790391247.308460:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1790391247.308473:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1790391247.308573:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1790391247.308581:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.128@tcp (null) (null) (null) 00000040:00080000:1.0:1790391247.308592:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1790391247.308596:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790391247.308607:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1790391247.308620:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.128@tcp (null) (null) 00000040:00080000:1.0:1790391247.308635:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1790391247.308641:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1790391247.308653:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1790391247.308668:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1790391247.308678:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1790391247.308764:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1790391247.308773:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1790391247.308786:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1790391247.308809:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1790391247.308824:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1790391247.308830:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1790391247.308841:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1790391247.308859:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1790391247.308864:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1790391247.308908:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1790391247.308914:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1790391247.309568:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1790391247.309769:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1790391247.309789:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.128@tcp for mdt 20000000:01000000:3.0:1790391247.309791:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.128@tcp (null) (null) (null) 00000040:00080000:3.0:1790391247.309806:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1790391247.309821:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790391247.309835:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1790391247.309840:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.128@tcp (null) (null) 00000040:00080000:3.0:1790391247.309857:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1790391247.309865:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1790391247.309940:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1790391247.309957:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1790391247.309999:0:6505:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1790391247.310006:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1790391247.310489:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1790391247.310626:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1790391247.310639:0:6505:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.128@tcp for mdt 20000000:01000000:1.0:1790391247.310641:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.128@tcp (null) (null) (null) 00000040:00080000:1.0:1790391247.310655:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1790391247.310661:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790391247.310673:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1790391247.310678:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.128@tcp (null) (null) 00000040:00080000:1.0:1790391247.310689:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1790391247.310695:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1790391247.310707:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1790391247.310720:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1790391247.310747:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790391247.310756:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790391247.310760:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790391247.310815:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790391247.310817:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790391247.311588:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1790391247.311612:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1790391247.311628:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1790391247.311793:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1790391247.311813:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1790391247.311833:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1790391247.311842:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790391247.311844:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790391247.312255:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1790391247.312273:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1790391247.312284:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1790391247.312512:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1790391247.312529:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1790391247.312541:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1790391247.312548:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1790391247.312550:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790391247.312786:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1790391247.312803:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1790391247.312816:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1790391247.313246:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1790391247.313261:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1790391247.313273:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1790391247.313282:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790391247.313284:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790391247.313288:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1790391247.313293:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1790391247.313616:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1790391247.313711:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790391247.321824:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790391247.321870:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.322509:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008f98c48e/0x2b1b7949f13e0a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0a94 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.322516:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ab0 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.322536:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b83df72c/0x2b1b7949f13e0b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b20 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.322543:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.322583:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b83df72c/0x2b1b7949f13e0b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0b20 expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.322596:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b83df72c/0x2b1b7949f13e0b27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b20 expref: 12 pid: 6507 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391247.322610:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186312448:0@lo:104: 00000100:00100000:1.0:1790391247.322677:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790391247.322776:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0ab0 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.322783:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ab0 expref: 12 pid: 6505 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391247.322791:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001027a4fd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186312576:0@lo:104: 00000100:00100000:1.0:1790391247.322811:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790391247.323300:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008f98c48e/0x2b1b7949f13e0a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0a94 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.323309:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008f98c48e/0x2b1b7949f13e0a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0a94 expref: 12 pid: 6506 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391247.323331:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ab1e233 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186312704:0@lo:104: 00000100:00100000:1.0:1790391247.323363:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.323508:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186312448 00000100:00100000:3.0:1790391247.323515:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186312448 00000100:00100000:3.0:1790391247.323549:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186312576 00000100:00100000:3.0:1790391247.323552:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186312576 00000100:00100000:3.0:1790391247.323564:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391247.323571:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006951d4a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6505:x1877361186312448:12345-0@lo:104: 00010000:00010000:3.0:1790391247.323583:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323634:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790391247.323638:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006951d4a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6505:x1877361186312448:12345-0@lo:104: Request processed in 68us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391247.323645:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391247.323662:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391247.323667:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b566455a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6505:x1877361186312576:12345-0@lo:104: 00010000:00010000:3.0:1790391247.323673:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323702:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790391247.323711:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b566455a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6505:x1877361186312576:12345-0@lo:104: Request processed in 45us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391247.323717:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790391247.323749:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391247.323754:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323762:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c151fd93 already unused, calling callback (000000000b92e0f5) 10000000:00010000:3.0:1790391247.323764:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323772:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391247.323778:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391247.323784:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790391247.323815:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323822:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391247.323837:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323844:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: 00000000c151fd93/0x2b1b7949f13e0b20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b27 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323854:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391247.323856:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323871:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2bf0067 already unused, calling callback (000000000b92e0f5) 10000000:00010000:3.0:1790391247.323873:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323897:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391247.323902:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391247.323907:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790391247.323920:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323925:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391247.323936:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323942:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0ab7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.323950:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391247.323951:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391247.323953:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391247.323958:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391247.323975:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b415e831 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186312832:0@lo:103: 00000100:00100000:3.0:1790391247.324001:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.324030:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004450a413 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186312960:0@lo:103: 00000100:00100000:3.0:1790391247.324058:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.324085:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186312832 00000100:00100000:3.0:1790391247.324089:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186312832 00010000:00010000:3.0:1790391247.324103:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b83df72c/0x2b1b7949f13e0b27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b20 expref: 13 pid: 6507 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391247.324121:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186312960 00000100:00100000:3.0:1790391247.324123:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186312960 00010000:00010000:3.0:1790391247.324130:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0ab7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ab0 expref: 14 pid: 6505 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391247.324140:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391247.324144:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb60885c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:3640:x1877361186312832:12345-0@lo:103: 00010000:00010000:3.0:1790391247.324153:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391247.324157:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b83df72c/0x2b1b7949f13e0b27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b20 expref: 14 pid: 6507 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.324167:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b83df72c/0x2b1b7949f13e0b27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b20 expref: 14 pid: 6507 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.324181:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391247.324205:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb60885c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:3640:x1877361186312832:12345-0@lo:103: Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391247.324212:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391247.324223:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391247.324228:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039155ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:3637:x1877361186312960:12345-0@lo:103: 00010000:00010000:3.0:1790391247.324235:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391247.324238:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0ab7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ab0 expref: 13 pid: 6505 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.324255:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ab0 expref: 13 pid: 6505 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.324264:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391247.324286:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039155ca7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:3637:x1877361186312960:12345-0@lo:103: Request processed in 58us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391247.324291:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391247.324466:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004450a413 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186312960:0@lo:103: 00000100:00100000:3.0:1790391247.324491:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b415e831 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186312832:0@lo:103: 00000100:00100000:1.0:1790391247.324597:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 000000005acc56bb going to sleep for 11 seconds 00010000:00010000:1.0:1790391247.324609:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b83df72c/0x2b1b7949f13e0b27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0b20 expref: 12 pid: 6507 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391247.324618:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186312448:0@lo:104: 00010000:00010000:1.0:1790391247.324624:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0ab0 expref: 11 pid: 6505 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391247.324631:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001027a4fd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186312576:0@lo:104: 00000100:00100000:3.0:1790391247.324669:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186312704 00000100:00100000:3.0:1790391247.324673:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186312704 00000100:00100000:3.0:1790391247.324689:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391247.324693:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1b6af89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6505:x1877361186312704:12345-0@lo:104: 00010000:00010000:3.0:1790391247.324700:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.324766:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790391247.324770:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1b6af89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6505:x1877361186312704:12345-0@lo:104: Request processed in 77us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391247.324776:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790391247.324790:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391247.324793:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.324798:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004bcf50a8 already unused, calling callback (000000000b92e0f5) 10000000:00010000:3.0:1790391247.324801:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.324812:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391247.324818:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391247.324822:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790391247.324839:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.324844:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391247.324853:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.324858:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: 000000004bcf50a8/0x2b1b7949f13e0a94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0a9b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.324871:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391247.324872:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391247.324874:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391247.324903:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b415e831 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186313088:0@lo:103: 00000100:00100000:3.0:1790391247.324926:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.324954:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186313088 00000100:00100000:3.0:1790391247.324957:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186313088 00010000:00010000:3.0:1790391247.324968:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008f98c48e/0x2b1b7949f13e0a9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0a94 expref: 11 pid: 6506 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391247.324985:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391247.324990:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004450a413 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:3638:x1877361186313088:12345-0@lo:103: 00010000:00010000:3.0:1790391247.325002:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391247.325006:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008f98c48e/0x2b1b7949f13e0a9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0a94 expref: 11 pid: 6506 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325014:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008f98c48e/0x2b1b7949f13e0a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0a94 expref: 11 pid: 6506 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325025:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325032:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325045:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325051:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325056:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325061:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325066:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a4999a1e already unused, calling callback (000000002575b2ae) 00010000:00010000:3.0:1790391247.325069:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325075:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325092:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.325100:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391247.325126:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004450a413 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:3638:x1877361186313088:12345-0@lo:103: Request processed in 135us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391247.325131:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391247.325158:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b415e831 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186313088:0@lo:103: 00010000:00010000:1.0:1790391247.325230:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008f98c48e/0x2b1b7949f13e0a9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0a94 expref: 10 pid: 6506 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391247.325239:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ab1e233 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186312704:0@lo:104: 00010000:00010000:1.0:1790391247.325254:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.325261:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.325266:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.325271:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b66 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790391247.325285:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1790391247.327816:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e7e7fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:7442:x1877361186312320:12345-0@lo:253: Request processed in 19894us (20214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391247.327831:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391247.328045:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186312320:0@lo:253: 10000000:01000000:2.0:1790391247.328061:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790391247.328064:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790391247.328066:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790391247.328067:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391247.328068:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1790391247.328070:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391247.328071:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391247.328072:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790391247.328073:0:7442:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790391247.328074:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391247.328075:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790391247.328146:0:7442:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009f607e4c from lustre-MDT0001 10000000:01000000:3.0:1790391247.328176:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1790391247.328179:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790391247.328186:0:7442:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e52ae8c99c0 local copy 10000000:01000000:3.0:1790391247.328190:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790391247.328223:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.328233:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.328241:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391247.328259:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b415e831 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313216:0@lo:101: 00000100:00100000:3.0:1790391247.328294:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.328443:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c48740f3 going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.328488:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186313216 00000100:00100000:2.0:1790391247.328493:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186313216 00000100:00100000:2.0:1790391247.328536:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790391247.328543:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb4a4315 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:7442:x1877361186313216:12345-0@lo:101: 00010000:00010000:2.0:1790391247.328554:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391247.328566:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004bd77483/0x2b1b7949f13e0b74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0b6d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.328586:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004bd77483/0x2b1b7949f13e0b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b6d expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.328596:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004bd77483/0x2b1b7949f13e0b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b6d expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.328603:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004bd77483, rc 0) 00000100:00100000:2.0:1790391247.328677:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb4a4315 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+10:7442:x1877361186313216:12345-0@lo:101: Request processed in 134us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.328684:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391247.328794:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b415e831 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313216:0@lo:101: 00010000:00010000:0.0:1790391247.328808:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.328829:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391247.329102:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313344:0@lo:501: 00000100:00100000:0.0:1790391247.329130:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.329192:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048151136 going to sleep for 11 seconds 00000100:00100000:1.0:1790391247.329234:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186313344 00000100:00100000:1.0:1790391247.329239:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186313344 00000100:00100000:1.0:1790391247.329298:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790391247.329305:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6f87349 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+10:7442:x1877361186313344:12345-0@lo:501: 00000100:00100000:1.0:1790391247.329493:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6f87349 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+10:7442:x1877361186313344:12345-0@lo:501: Request processed in 188us (362us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391247.329500:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391247.329561:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313344:0@lo:501: 10000000:01000000:0.0:1790391247.329574:0:7442:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790391247.329593:0:7442:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790391247.329597:0:7442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.329604:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.329610:0:7442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.329631:0:7442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790391247.329653:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e52b5eaa800 10000000:01000000:0.0:1790391247.329657:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790391247.329662:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e52ae8c99c0 10000000:01000000:0.0:1790391247.329663:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790391247.329666:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e52ae8c99c0 from 1 10000000:01000000:0.0:1790391247.329668:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790391247.329685:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000a6dda782/0x2b1b7949f13e0b7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.329703:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000a6dda782/0x2b1b7949f13e0b7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.329711:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000a6dda782/0x2b1b7949f13e0b7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391247.329724:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313472:0@lo:101: 00000100:00100000:0.0:1790391247.329759:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391247.329791:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391247.329796:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.329812:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cd2a8219 already unused, calling callback (000000000b92e0f5) 10000000:00010000:3.0:1790391247.329815:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.329821:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391247.329826:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391247.329831:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790391247.329848:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.329853:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391247.329868:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.329874:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: 00000000cd2a8219/0x2b1b7949f13e0b6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2b1b7949f13e0b74 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.329908:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391247.329909:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391247.329911:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391247.329920:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd798349 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186313600:0@lo:103: 00000100:00100000:3.0:1790391247.329947:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.329982:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186313600 00000100:00100000:3.0:1790391247.329986:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186313600 00000100:00100000:3.0:1790391247.330014:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391247.330027:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064052e95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+10:3639:x1877361186313600:12345-0@lo:103: 00010000:00010000:3.0:1790391247.330036:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391247.330046:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004bd77483/0x2b1b7949f13e0b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0b6d expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.330057:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391247.330085:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064052e95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:3639:x1877361186313600:12345-0@lo:103: Request processed in 59us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391247.330091:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391247.330118:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd798349 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186313600:0@lo:103: 00000100:00100000:0.0:1790391247.330486:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013da53f8 going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.330558:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186313472 00000100:00100000:2.0:1790391247.330569:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186313472 00000100:00100000:2.0:1790391247.330590:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790391247.330596:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056181fec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+9:7442:x1877361186313472:12345-0@lo:101: 00010000:00010000:2.0:1790391247.330605:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391247.330615:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042e5b943/0x2b1b7949f13e0b82 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0b7b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.330630:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042e5b943/0x2b1b7949f13e0b82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b7b expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.330639:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042e5b943/0x2b1b7949f13e0b82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b7b expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.330645:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042e5b943, rc 0) 00000100:00100000:2.0:1790391247.330723:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056181fec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+10:7442:x1877361186313472:12345-0@lo:101: Request processed in 127us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.330729:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391247.330804:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313472:0@lo:101: 00010000:00010000:0.0:1790391247.330818:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000a6dda782/0x2b1b7949f13e0b7b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b82 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.330826:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000a6dda782/0x2b1b7949f13e0b7b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0b82 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391247.330840:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790391247.330856:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000a6dda782/0x2b1b7949f13e0b7b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b82 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.330863:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 00000000a6dda782/0x2b1b7949f13e0b7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b82 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391247.330871:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e52b5eaa800 10000000:01000000:0.0:1790391247.330896:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790391247.330901:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e52b5eaa800 from 1 10000000:01000000:0.0:1790391247.330903:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790391247.330921:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 000000002536b386/0x2b1b7949f13e0b89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.330934:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 000000002536b386/0x2b1b7949f13e0b89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.330941:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 000000002536b386/0x2b1b7949f13e0b89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391247.330954:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313728:0@lo:101: 00000100:00100000:0.0:1790391247.330982:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.330995:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013da53f8 going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.331074:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186313728 00000100:00100000:2.0:1790391247.331079:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186313728 00000100:00100000:2.0:1790391247.331098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391247.331103:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c82f75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+10:7442:x1877361186313728:12345-0@lo:101: 00010000:00010000:2.0:1790391247.331109:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391247.331117:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c151fd93/0x2b1b7949f13e0b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0b89 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.331129:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c151fd93/0x2b1b7949f13e0b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b89 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.331135:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c151fd93/0x2b1b7949f13e0b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b89 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.331152:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c151fd93, rc 0) 00000100:00100000:2.0:1790391247.331176:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c82f75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:7442:x1877361186313728:12345-0@lo:101: Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.331182:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790391247.331249:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313728:0@lo:101: 00010000:00010000:0.0:1790391247.331259:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 000000002536b386/0x2b1b7949f13e0b89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.331266:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 000000002536b386/0x2b1b7949f13e0b89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391247.331275:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790391247.331289:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 000000002536b386/0x2b1b7949f13e0b89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.331296:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 000000002536b386/0x2b1b7949f13e0b89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391247.331301:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790391247.331305:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790391247.331309:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e52b5eaa800 10000000:01000000:0.0:1790391247.331311:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790391247.331437:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1790391247.331444:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1790391247.331460:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 000000003b769297/0x2b1b7949f13e0b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.331467:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 000000003b769297/0x2b1b7949f13e0b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.331473:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 000000003b769297/0x2b1b7949f13e0b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391247.331484:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313856:0@lo:101: 00000100:00100000:0.0:1790391247.331509:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.331526:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013da53f8 going to sleep for 11 seconds 00000100:00100000:1.0:1790391247.331584:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186313856 00000100:00100000:1.0:1790391247.331588:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186313856 00000100:00100000:1.0:1790391247.331641:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790391247.331646:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b456749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+11:7442:x1877361186313856:12345-0@lo:101: 00010000:00010000:1.0:1790391247.331653:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391247.331660:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0b97 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.331672:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b97 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.331680:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a4999a1e/0x2b1b7949f13e0b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b97 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.331685:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a4999a1e, rc 0) 00000100:00100000:1.0:1790391247.331721:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b456749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186313856:12345-0@lo:101: Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391247.331727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790391247.331843:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313856:0@lo:101: 00010000:00010000:0.0:1790391247.331852:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 000000003b769297/0x2b1b7949f13e0b97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.331859:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 000000003b769297/0x2b1b7949f13e0b97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391247.331958:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313984:0@lo:501: 00000100:00100000:0.0:1790391247.331983:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.331991:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013da53f8 going to sleep for 11 seconds 00000100:00100000:1.0:1790391247.332054:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186313984 00000100:00100000:1.0:1790391247.332057:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186313984 00000100:00100000:1.0:1790391247.332072:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790391247.332076:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024081b9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186313984:12345-0@lo:501: 00000100:00100000:1.0:1790391247.332183:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024081b9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186313984:12345-0@lo:501: Request processed in 106us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391247.332189:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790391247.332439:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186313984:0@lo:501: 00000100:00100000:0.0:1790391247.332464:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186314112:0@lo:503: 00000100:00100000:0.0:1790391247.332500:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.332530:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013da53f8 going to sleep for 11 seconds 00000100:00100000:1.0:1790391247.332579:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186314112 00000100:00100000:1.0:1790391247.332585:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186314112 00000100:00100000:1.0:1790391247.332614:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391247.332619:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de79e60d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186314112:12345-0@lo:503: 00000100:00100000:1.0:1790391247.332750:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de79e60d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186314112:12345-0@lo:503: Request processed in 130us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391247.332757:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790391247.333043:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186314112:0@lo:503: 00000040:00080000:0.0:1790391247.333281:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790391247.333499:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186314240:0@lo:502: 00000100:00100000:0.0:1790391247.333540:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.333607:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013da53f8 going to sleep for 11 seconds 00000100:00100000:1.0:1790391247.333650:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186314240 00000100:00100000:1.0:1790391247.333655:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186314240 00000100:00100000:1.0:1790391247.333836:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790391247.333844:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e8e9212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186314240:12345-0@lo:502: 00000100:00100000:1.0:1790391247.334156:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e8e9212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186314240:12345-0@lo:502: Request processed in 313us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391247.334163:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790391247.334245:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186314240:0@lo:502: 00000040:00080000:0.0:1790391247.341200:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790391247.341252:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1790391247.341267:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1790391247.341279:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1790391247.341291:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1790391247.341302:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1790391247.341487:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1790391247.341506:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1790391247.341518:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1790391247.341530:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1790391247.341542:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1790391247.341554:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1790391247.341567:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1790391247.341579:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1790391247.341614:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1790391247.341628:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1790391247.341638:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1790391247.341649:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1790391247.341660:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1790391247.341672:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1790391247.341683:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1790391247.341695:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1790391247.341707:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1790391247.341762:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186314368:0@lo:502: 00000100:00100000:0.0:1790391247.341841:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391247.341965:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186314368 00000100:00100000:2.0:1790391247.341973:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186314368 00000100:00100000:2.0:1790391247.342025:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790391247.342033:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b2681b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186314368:12345-0@lo:502: 00000100:00100000:0.0:1790391247.342174:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013da53f8 going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.348558:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b2681b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186314368:12345-0@lo:502: Request processed in 6518us (6709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.348573:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790391247.348814:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186314368:0@lo:502: 00000040:00080000:0.0:1790391247.349007:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1790391247.349021:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1790391247.353016:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391247.353032:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391247.353035:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790391247.353041:0:7454:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1790391247.353044:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391247.353060:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000831e3127) 00000020:00000080:0.0:1790391247.353080:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1790391247.353086:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790391247.353180:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790391247.353188:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e0bac 00000020:00000080:0.0:1790391247.354800:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1790391247.354809:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391247.354815:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391247.354817:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790391247.354820:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391247.354825:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391247.354826:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1790391247.354829:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391247.354839:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000000b7e505d) 00000020:00000080:0.0:1790391247.354857:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1790391247.354861:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790391247.354863:0:7454:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1790391247.354866:0:7454:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1790391247.354871:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790391247.354958:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009f607e4c from lustre-MDT0001, refs=2 00000020:00000080:0.0:1790391247.354972:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000260a389c) 00000020:00000080:0.0:1790391247.354981:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1790391247.355055:0:7454:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790391247.355066:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e0bc1 00000020:00000080:0.0:1790391247.355158:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1790391247.355164:0:7454:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790391247.355167:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2b1b7949f13e0bc8 00080000:01000000:0.0:1790391247.355172:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790391247.355175:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e0bcf 00080000:10000000:1.0:1790391247.358111:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1790391247.358308:0:7454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1790391247.469074:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1790391247.469308:0:7454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1790391247.472482:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790391247.472828:0:7454:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790391247.495135:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1790391247.495148:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391247.495155:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391247.495157:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1790391247.495161:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391247.495167:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391247.495168:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1790391247.495171:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790391247.495176:0:7454:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:00000080:1.0:1790391247.495209:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391247.495224:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000082c6a7c4) 00000020:00000080:1.0:1790391247.495245:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1790391247.495250:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790391247.495327:0:7454:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1790391247.495333:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790391247.495339:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e0bdd 00010000:00080000:1.0:1790391247.495370:0:7454:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001db5a2e0@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:1.0:1790391247.502583:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1790391247.515041:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790391247.515056:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790391247.515100:0:7454:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790391247.515133:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e0be4 00000100:00080000:1.0:1790391247.515142:0:7454:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391247.515148:0:7454:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000001db5a2e0 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391247.515184:0:7454:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000ab1e233 x1877361186314496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391247.515206:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1790391247.515265:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391247.515268:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391247.515270:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1790391247.515272:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790391247.515275:0:7454:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790391247.515276:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790391247.515277:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790391247.515278:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790391247.515281:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391247.515282:0:7454:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790391247.515284:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391247.515288:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391247.515289:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1790391247.515309:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790391247.515339:0:7454:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790391247.515351:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391247.515354:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391247.515356:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1790391247.515358:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391247.515361:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391247.515362:0:7454:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790391247.515365:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790391247.515367:0:7454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790391247.515393:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391247.515396:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391247.515397:0:7454:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790391247.515400:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1790391247.515514:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186314624:0@lo:400: 00000100:00100000:0.0:1790391247.515580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.515655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186314624 00000100:00100000:0.0:1790391247.515661:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186314624 00000020:01000000:2.0:1790391247.515784:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1790391247.515813:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790391247.515828:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 000000003b769297/0x2b1b7949f13e0b97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.515839:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 000000003b769297/0x2b1b7949f13e0b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391247.515846:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e52b5eaa800 from 1 10000000:01000000:2.0:1790391247.515849:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391247.515872:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391247.515920:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ab1e233 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186314496:0@lo:38: 00000100:00100000:3.0:1790391247.516005:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.516067:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391247.516077:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003276340f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186314624:12345-0@lo:400: 00000100:00100000:0.0:1790391247.516124:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003276340f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186314624:12345-0@lo:400: Request processed in 50us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391247.516131:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790391247.518832:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.518848:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391247.518905:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186314752:0@lo:101: 00000100:00100000:2.0:1790391247.518970:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391247.519146:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186314752 00000100:00100000:1.0:1790391247.519153:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186314752 00000100:00100000:1.0:1790391247.519198:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391247.519206:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cc5e0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+12:7442:x1877361186314752:12345-0@lo:101: 00010000:00010000:1.0:1790391247.519219:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391247.519232:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0bf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0beb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.519256:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0beb expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.519265:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0beb expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.519273:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c264268d, rc 0) 00000100:00100000:1.0:1790391247.519305:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cc5e0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:7442:x1877361186314752:12345-0@lo:101: Request processed in 101us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391247.519321:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391247.522856:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186314496 00000100:00100000:3.0:1790391247.522872:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186314496 00010000:00080000:1.0:1790391247.522973:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b8c7823c x1877361186314624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391247.522992:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c7823c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186314624:0@lo:400: 00000100:00100000:3.0:1790391247.524099:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391247.524106:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd798349 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186314496:12345-0@lo:38: 00010000:00080000:3.0:1790391247.524136:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:3.0:1790391247.524170:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e0bf9 00000004:00100000:3.0:1790391247.524186:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790391247.524191:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1790391247.524802:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060e31f5e going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.524829:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186314752:0@lo:101: 00010000:00010000:2.0:1790391247.524849:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.524860:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391247.526474:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186314880:0@lo:256: 00000100:00100000:2.0:1790391247.526555:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391247.526678:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060e31f5e going to sleep for 11 seconds 00000100:00080000:1.0:1790391247.532993:0:6517:0:(import.c:65:import_set_state_nolock()) 0000000010d78682 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391247.533088:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd798349 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1877361186314496:12345-0@lo:38: Request processed in 8978us (17080us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391247.533104:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391247.533297:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391247.533306:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1790391247.533327:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1790391247.533342:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790391247.533344:0:3636:0:(import.c:65:import_set_state_nolock()) 000000001db5a2e0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790391247.533359:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ab1e233 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186314496:0@lo:38: 00000100:00100000:1.0:1790391247.533633:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391247.533645:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000078d3a53f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186315008:0@lo:41: 00000100:00100000:1.0:1790391247.533687:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391247.533999:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186315008 00000100:00100000:2.0:1790391247.534007:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186315008 00000100:00100000:2.0:1790391247.534047:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391247.534056:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001027a4fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1877361186315008:12345-0@lo:41: 00000004:00000024:2.0:1790391247.534097:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1790391247.534141:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001027a4fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1877361186315008:12345-0@lo:41: Request processed in 86us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.534148:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391247.534188:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000078d3a53f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186315008:0@lo:41: 00000100:00100000:0.0:1790391247.534936:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186314880 00000100:00100000:0.0:1790391247.534944:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186314880 00000100:00100000:0.0:1790391247.534980:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790391247.534986:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008bc0639 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:7442:x1877361186314880:12345-0@lo:256: 20000000:01000000:0.0:1790391247.535002:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790391247.535020:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790391247.535024:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1790391247.535118:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008bc0639 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:7442:x1877361186314880:12345-0@lo:256: Request processed in 132us (8564us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391247.535126:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790391247.535221:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186314880:0@lo:256: 10000000:01000000:2.0:1790391247.536047:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790391247.536065:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.536083:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391247.536092:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b5eaa800 from 1 10000000:01000000:2.0:1790391247.536095:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391247.536122:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.536129:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.536139:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391247.536155:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315136:0@lo:101: 00000100:00100000:2.0:1790391247.536197:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391247.536238:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060e31f5e going to sleep for 11 seconds 00000100:00100000:1.0:1790391247.536339:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186315136 00000100:00100000:1.0:1790391247.536345:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186315136 00000100:00100000:1.0:1790391247.536382:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391247.536388:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000048af62c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:7442:x1877361186315136:12345-0@lo:101: 00010000:00010000:1.0:1790391247.536398:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391247.536410:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000297613c4/0x2b1b7949f13e0c07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0c00 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.536431:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000297613c4/0x2b1b7949f13e0c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c00 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.536440:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000297613c4/0x2b1b7949f13e0c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c00 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391247.536448:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000297613c4, rc 0) 00000100:00100000:1.0:1790391247.536478:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000048af62c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:7442:x1877361186315136:12345-0@lo:101: Request processed in 90us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391247.536489:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790391247.537304:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315136:0@lo:101: 00010000:00010000:2.0:1790391247.537435:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.537444:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391247.537548:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315264:0@lo:501: 00000100:00100000:2.0:1790391247.537584:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391247.537650:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060e31f5e going to sleep for 11 seconds 00000100:00100000:1.0:1790391247.547047:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186315264 00000100:00100000:1.0:1790391247.547064:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186315264 00000100:00100000:1.0:1790391247.547127:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790391247.547134:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7982ca3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:7442:x1877361186315264:12345-0@lo:501: 00000100:00100000:1.0:1790391247.547292:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7982ca3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:7442:x1877361186315264:12345-0@lo:501: Request processed in 159us (9708us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391247.547299:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790391247.547549:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b2983ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315264:0@lo:501: 00000100:00100000:0.0:1790391247.547594:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004f8651b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315392:0@lo:503: 00000100:00100000:0.0:1790391247.547647:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.547694:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d31b0b4e going to sleep for 11 seconds 00000100:00100000:3.0:1790391247.547858:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186315392 00000100:00100000:3.0:1790391247.547863:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186315392 00000100:00100000:3.0:1790391247.547916:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790391247.547921:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051b30ad0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:7442:x1877361186315392:12345-0@lo:503: 00000040:00080000:3.0:1790391247.547954:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391247.547984:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051b30ad0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:7442:x1877361186315392:12345-0@lo:503: Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391247.547991:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790391247.548103:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004f8651b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315392:0@lo:503: 00000040:00080000:0.0:1790391247.548485:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391247.548532:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1790391247.548595:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391247.550253:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1790391247.554422:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790391247.554470:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391247.554529:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.554542:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391247.554603:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790391247.554605:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e52b5eaa800 10000000:01000000:0.0:1790391247.554609:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e52b5eaa800 10000000:01000000:0.0:1790391247.554612:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790391247.554618:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52b5eaa800 from 1 10000000:01000000:0.0:1790391247.554621:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790391247.554658:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000b83df72c/0x2b1b7949f13e0c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.554666:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000b83df72c/0x2b1b7949f13e0c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.554676:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000b83df72c/0x2b1b7949f13e0c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391247.554714:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004f8651b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315520:0@lo:101: 00000100:00100000:0.0:1790391247.554791:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.555090:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf28709f going to sleep for 11 seconds 00000100:00100000:3.0:1790391247.556970:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186315520 00000100:00100000:3.0:1790391247.556984:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186315520 00000100:00100000:3.0:1790391247.557049:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790391247.557059:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000845c4086 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:7442:x1877361186315520:12345-0@lo:101: 00010000:00010000:3.0:1790391247.557075:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391247.557090:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd2a8219/0x2b1b7949f13e0c15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0c0e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.557117:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd2a8219/0x2b1b7949f13e0c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c0e expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.557128:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd2a8219/0x2b1b7949f13e0c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c0e expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.557137:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd2a8219, rc 0) 00000100:00100000:3.0:1790391247.557857:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000845c4086 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186315520:12345-0@lo:101: Request processed in 797us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391247.557926:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790391247.560554:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004f8651b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315520:0@lo:101: 00010000:00010000:0.0:1790391247.560585:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000b83df72c/0x2b1b7949f13e0c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.560598:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000b83df72c/0x2b1b7949f13e0c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391247.560799:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004f8651b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315648:0@lo:501: 00000100:00100000:0.0:1790391247.560859:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.562038:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf28709f going to sleep for 11 seconds 00000100:00100000:1.0:1790391247.563986:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186315648 00000100:00100000:1.0:1790391247.564001:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186315648 00000100:00100000:0.0:1790391247.564183:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790391247.564194:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa25f7af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186315648:12345-0@lo:501: 00000100:00100000:0.0:1790391247.564535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa25f7af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186315648:12345-0@lo:501: Request processed in 343us (3676us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391247.564544:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790391247.564630:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004f8651b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315648:0@lo:501: 00000100:00100000:1.0:1790391247.564676:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315776:0@lo:503: 00000100:00100000:1.0:1790391247.564837:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391247.564950:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba312b8c going to sleep for 11 seconds 00000100:00100000:0.0:1790391247.565074:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186315776 00000100:00100000:0.0:1790391247.565079:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186315776 00000100:00100000:0.0:1790391247.565132:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790391247.565138:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060ed9ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186315776:12345-0@lo:503: 00000100:00100000:0.0:1790391247.565219:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060ed9ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186315776:12345-0@lo:503: Request processed in 81us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391247.565226:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790391247.565289:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315776:0@lo:503: 00000040:00080000:1.0:1790391247.565554:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391247.565611:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315904:0@lo:502: 00000100:00100000:1.0:1790391247.565641:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391247.566112:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013da53f8 going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.566178:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186315904 00000100:00100000:2.0:1790391247.566183:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186315904 00000100:00100000:2.0:1790391247.566208:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391247.566213:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d295d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186315904:12345-0@lo:502: 00000100:00100000:2.0:1790391247.566298:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d295d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186315904:12345-0@lo:502: Request processed in 85us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.566306:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790391247.566436:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186315904:0@lo:502: 00000040:00080000:1.0:1790391247.566592:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790391247.566614:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790391247.566626:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790391247.566636:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790391247.566647:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790391247.566666:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790391247.566677:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790391247.566687:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790391247.566713:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790391247.566726:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790391247.566749:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790391247.566763:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790391247.566774:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790391247.566786:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790391247.566797:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790391247.566809:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790391247.566820:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790391247.566830:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790391247.566840:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790391247.566851:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790391247.566863:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790391247.566874:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790391247.566911:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790391247.566924:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790391247.566937:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1790391247.566948:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1790391247.566960:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1790391247.566971:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1790391247.566996:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186316032:0@lo:502: 00000100:00100000:1.0:1790391247.567036:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391247.567054:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba312b8c going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.572004:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186316032 00000100:00100000:2.0:1790391247.572021:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186316032 00000100:00100000:2.0:1790391247.572060:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391247.572067:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075b53093 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186316032:12345-0@lo:502: 00000100:00100000:2.0:1790391247.572227:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075b53093 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186316032:12345-0@lo:502: Request processed in 159us (5190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.572234:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391247.574632:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186316032:0@lo:502: 00000040:00080000:2.0:1790391247.575492:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1790391247.575510:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1790391247.577082:0:7460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1790391247.577114:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000fbfd13dd) 00000020:00000080:0.0:1790391247.577136:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1790391247.577216:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009f607e4c from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790391247.577221:0:7460:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009f607e4c from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790391247.577228:0:7460:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009f607e4c 3 00010000:00080000:0.0:1790391247.577258:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000eaca949e@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:0.0:1790391247.580292:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1790391247.581073:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1790391247.581114:0:7460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790391247.581128:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2b1b7949f13e0c23 00000100:00080000:0.0:1790391247.581138:0:7460:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391247.581143:0:7460:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000eaca949e using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391247.581178:0:7460:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ff3a26c1 x1877361186316160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391247.581207:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790391247.582374:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff3a26c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186316160:0@lo:38: 00000100:00100000:3.0:1790391247.582447:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.582864:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186316160 00000100:00100000:0.0:1790391247.582872:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186316160 00000100:00100000:0.0:1790391247.582928:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391247.582935:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dcd085e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186316160:12345-0@lo:38: 00010000:00080000:0.0:1790391247.582960:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1790391247.582990:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2b1b7949f13e0c2a 00000004:00100000:0.0:1790391247.583005:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790391247.583031:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000d8ce3c10 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391247.583083:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dcd085e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1877361186316160:12345-0@lo:38: Request processed in 148us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391247.583091:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1790391247.583180:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:3.0:1790391247.583849:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ff3a26c1 x1877361186316160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391247.583861:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391247.583869:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1790391247.583907:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790391247.583911:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790391247.583914:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000eaca949e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790391247.583919:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff3a26c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186316160:0@lo:38: 00000020:01000000:3.0:1790391247.583946:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1790391247.583975:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790391247.583991:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000b83df72c/0x2b1b7949f13e0c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.584001:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 00000000b83df72c/0x2b1b7949f13e0c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790391247.584053:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790391247.584056:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790391247.584057:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391247.584058:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391247.584059:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391247.584060:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391247.584062:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790391247.584063:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790391247.584064:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790391247.584066:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391247.584072:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790391247.584076:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1790391247.584078:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790391247.584079:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790391247.584080:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391247.584081:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391247.584081:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391247.584082:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391247.584083:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790391247.584084:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790391247.584084:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790391247.584085:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391247.584086:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790391247.584105:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790391247.584116:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ac89477 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186316288:0@lo:253: 00000100:00100000:3.0:1790391247.584162:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.584193:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e00c9ea going to sleep for 11 seconds 40000000:00080000:3.0:1790391247.584242:0:7461:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1790391247.585828:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186316288 00000100:00100000:0.0:1790391247.585837:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186316288 00000100:00100000:0.0:1790391247.585910:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790391247.585918:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007097f396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186316288:12345-0@lo:253: 20000000:01000000:0.0:1790391247.585947:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790391247.585971:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1790391247.589549:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1790391247.589620:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790391247.589639:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1790391247.589955:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007097f396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7442:x1877361186316288:12345-0@lo:253: Request processed in 4034us (5788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391247.589968:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391247.590093:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ac89477 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7442:1877361186316288:0@lo:253: 10000000:01000000:1.0:1790391247.590108:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790391247.590112:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790391247.590114:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790391247.590115:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391247.590128:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391247.590129:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391247.590130:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391247.590131:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391247.590133:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790391247.590134:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790391247.590135:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391247.590136:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790391247.590150:0:7442:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1790391247.591905:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790391247.591915:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790391247.591935:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.591952:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000098169a9f/0x2b1b7949f13e0b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b4a expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.591959:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0beb expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.591977:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.592018:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0beb expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.592033:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0bf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0beb expref: 14 pid: 6505 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391247.592047:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000078d3a53f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186316416:0@lo:104: 00000100:00100000:2.0:1790391247.592105:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391247.592159:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000098169a9f/0x2b1b7949f13e0b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0b4a expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.592167:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000098169a9f/0x2b1b7949f13e0b51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b4a expref: 14 pid: 6507 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391247.592176:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000644fdf1f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186316544:0@lo:104: 00000100:00100000:2.0:1790391247.592197:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391247.592213:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e91f403 going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.592237:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186316416 00000100:00100000:2.0:1790391247.592243:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186316416 00000100:00100000:2.0:1790391247.592273:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186316544 00000100:00100000:2.0:1790391247.592276:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186316544 00000100:00100000:2.0:1790391247.592289:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391247.592295:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e12a1dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6528:x1877361186316416:12345-0@lo:104: 00010000:00010000:2.0:1790391247.592307:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.593712:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391247.593720:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e12a1dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6528:x1877361186316416:12345-0@lo:104: Request processed in 1424us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.593738:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391247.593768:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391247.593776:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000241bdc39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6528:x1877361186316544:12345-0@lo:104: 00010000:00010000:2.0:1790391247.593786:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391247.593816:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391247.593820:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000241bdc39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6528:x1877361186316544:12345-0@lo:104: Request processed in 48us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.593825:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391247.594478:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000078d3a53f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186316416:0@lo:104: 00000100:00100000:3.0:1790391247.594490:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000644fdf1f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186316544:0@lo:104: 00010000:00010000:3.0:1790391247.594512:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.594531:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391247.594535:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.594543:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000084ae29e6 already unused, calling callback (000000000b92e0f5) 10000000:00010000:3.0:1790391247.594546:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.594554:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391247.594576:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391247.594582:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790391247.595106:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.595115:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391247.595134:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.595140:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: 0000000084ae29e6/0x2b1b7949f13e0beb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0bf2 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.595152:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391247.595154:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.595159:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009e001803 already unused, calling callback (000000000b92e0f5) 10000000:00010000:3.0:1790391247.595161:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.595166:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391247.595171:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391247.595175:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00080000:10000000:1.0:1790391247.601287:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1790391247.601644:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:2.0:1790391247.601923:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391247.601945:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c708a52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186316672:0@lo:103: 00000100:00100000:2.0:1790391247.602019:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391247.602073:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391247.602148:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186316672 00000100:00100000:0.0:1790391247.602156:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186316672 00010000:00010000:0.0:1790391247.602188:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0bf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0beb expref: 15 pid: 6505 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391247.602217:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391247.602225:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d72731ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3637:x1877361186316672:12345-0@lo:103: 00010000:00010000:0.0:1790391247.602237:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391247.602242:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0bf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0beb expref: 15 pid: 6505 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.602254:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0beb expref: 15 pid: 6505 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.602270:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c264268d/0x2b1b7949f13e0bf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0beb expref: 15 pid: 6505 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391247.602284:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391247.602334:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d72731ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:3637:x1877361186316672:12345-0@lo:103: Request processed in 111us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391247.602342:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391247.602377:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c708a52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186316672:0@lo:103: 00080000:10000000:1.0:1790391247.603004:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1790391247.603162:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00010000:00010000:3.0:1790391247.603530:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.603540:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391247.603566:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.603573:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: 000000009e001803/0x2b1b7949f13e0b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b51 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.603586:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391247.603588:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391247.603589:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391247.604145:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391247.604159:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186316800:0@lo:103: 00000100:00100000:3.0:1790391247.604208:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.604455:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186316800 00000100:00100000:3.0:1790391247.604462:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186316800 00010000:00010000:3.0:1790391247.604483:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000098169a9f/0x2b1b7949f13e0b51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b4a expref: 14 pid: 6507 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391247.604507:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391247.604514:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4fafc9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:3640:x1877361186316800:12345-0@lo:103: 00010000:00010000:3.0:1790391247.604523:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391247.604526:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000098169a9f/0x2b1b7949f13e0b51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b4a expref: 14 pid: 6507 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604536:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000098169a9f/0x2b1b7949f13e0b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b4a expref: 14 pid: 6507 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604547:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098169a9f/0x2b1b7949f13e0b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0b4a expref: 14 pid: 6507 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604564:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604572:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790391247.604585:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012671002s 00010000:00010000:3.0:1790391247.604588:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604593:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604599:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604605:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604610:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000557c622e already unused, calling callback (000000002575b2ae) 00010000:00010000:3.0:1790391247.604613:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604620:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604632:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604641:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391247.604678:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4fafc9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:3640:x1877361186316800:12345-0@lo:103: Request processed in 164us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391247.604686:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790391247.604739:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604747:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391247.604752:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000557c622e/0x2b1b7949f13e0c31 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391247.604785:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186316800:0@lo:103: 00080000:10000000:1.0:1790391247.605195:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1790391247.605466:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1790391247.609572:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1790391247.609779:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1790391247.610088:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1790391247.610231:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1790391247.610554:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1790391247.610714:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1790391247.630171:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1790391247.630522:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1790391247.630572:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009dd9dda5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1877361186316928:0@lo:700: 00000100:00100000:1.0:1790391247.630654:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391247.630710:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186316928 00000100:00100000:1.0:1790391247.630716:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186316928 00000100:00100000:1.0:1790391247.630768:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391247.630776:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dc4f856 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1877361186316928:12345-0@lo:700: 00000100:00100000:1.0:1790391247.630925:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d4d2e07 going to sleep for 11 seconds 00000040:01000000:3.0:1790391247.631001:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:0.0:1790391247.631221:0:7465:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1790391247.631226:0:7465:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 40000000:02000000:1.0:1790391247.635164:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1790391247.644719:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1877361186317056:0@lo:1000: 00000100:00100000:3.0:1790391247.644799:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.644872:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb2dde35 going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.644977:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186317056 00000100:00100000:2.0:1790391247.644986:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186317056 00000100:00100000:2.0:1790391247.645034:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391247.645042:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb60885c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1877361186317056:12345-0@lo:1000: 00000100:00100000:2.0:1790391247.645119:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb60885c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1877361186317056:12345-0@lo:1000: Request processed in 78us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.645126:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391247.645273:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1877361186317056:0@lo:1000: 00000040:01000000:3.0:1790391247.645303:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1790391247.645341:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1877361186317184:0@lo:700: 00000100:00100000:3.0:1790391247.645376:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.645406:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000855a8e0c going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.645457:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186317184 00000100:00100000:2.0:1790391247.645462:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186317184 00000100:00100000:2.0:1790391247.645502:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391247.645508:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039155ca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1877361186317184:12345-0@lo:700: 00000100:00100000:2.0:1790391247.645549:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039155ca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1877361186317184:12345-0@lo:700: Request processed in 42us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.645554:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391247.645740:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1877361186317184:0@lo:700: 00000100:00100000:3.0:1790391247.645782:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1877361186317312:0@lo:900: 00000100:00100000:3.0:1790391247.645805:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.645829:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000855a8e0c going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.645954:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186317312 00000100:00100000:2.0:1790391247.645959:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186317312 00000100:00100000:2.0:1790391247.645986:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391247.645992:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004450a413 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1877361186317312:12345-0@lo:900: 00000100:00100000:2.0:1790391247.646029:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004450a413 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1877361186317312:12345-0@lo:900: Request processed in 38us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.646035:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790391247.646107:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000041bc58a4 x1877361186317312/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790391263 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391247.646119:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1877361186317312:0@lo:900: 00000100:00100000:3.0:1790391247.646171:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1877361186317440:0@lo:1000: 00000100:00100000:3.0:1790391247.646195:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.646216:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019833876 going to sleep for 11 seconds 00000100:00100000:2.0:1790391247.646253:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186317440 00000100:00100000:2.0:1790391247.646257:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186317440 00000100:00100000:2.0:1790391247.646286:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391247.646291:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064052e95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1877361186317440:12345-0@lo:1000: 00000100:00100000:2.0:1790391247.646350:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064052e95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1877361186317440:12345-0@lo:1000: Request processed in 59us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.646356:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391247.648135:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dc4f856 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1877361186316928:12345-0@lo:700: Request processed in 17355us (17476us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391247.648147:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391247.648270:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1877361186317440:0@lo:1000: 00000004:00080000:3.0:1790391247.648346:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000855a8e0c with version 0 00000020:00100000:3.0:1790391247.648367:0:7467:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790391247.648373:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000041bc58a4 x1877361186317696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391247.648389:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1877361186317696:0@lo:1000: 00000100:00100000:3.0:1790391247.648422:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.648442:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000858b60af going to sleep for 11 seconds 00000040:01000000:0.0:1790391247.649068:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1790391247.649182:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790391247.649614:0:7442:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790391247.649621:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1790391247.649755:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391247.650713:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790391247.651282:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790391247.651310:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1790391247.651465:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790391247.651668:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1790391247.652587:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186317696 00000100:00100000:2.0:1790391247.652599:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186317696 00000100:00100000:2.0:1790391247.652653:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391247.652661:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b531379 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1877361186317696:12345-0@lo:1000: 00010000:00080000:2.0:1790391247.653021:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009dd9dda5 x1877361186316928/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790391263 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391247.653036:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009dd9dda5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1877361186316928:0@lo:700: 40000000:02000000:2.0:1790391247.653048:0:7466:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1790391247.659140:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1790391247.659288:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1790391247.664558:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1790391247.664826:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1790391247.665496:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1790391247.668136:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1790391247.668280:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1790391247.670400:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1790391247.670591:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1790391247.670844:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1790391247.671208:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1790391247.671846:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1790391247.672618:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1790391247.673168:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000040:00080000:0.0:1790391247.679935:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1790391247.681677:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1790391247.682121:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b531379 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1877361186317696:12345-0@lo:1000: Request processed in 29457us (33695us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790391247.682135:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1790391247.688533:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1790391247.688544:0:7467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790391247.688579:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041bc58a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1877361186317696:0@lo:1000: 00000100:00100000:0.0:1790391247.688680:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001383b39d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1877361186317824:0@lo:1000: 00000100:00100000:0.0:1790391247.688764:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391247.688826:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 0000000093977024 going to sleep for 11 seconds 00100000:10000000:1.0:1790391247.689557:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1790391247.691249:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1790391247.691954:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1790391247.692103:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1790391247.692245:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000100:00100000:2.0:1790391247.692444:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186317824 00000100:00100000:2.0:1790391247.692455:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186317824 00000100:00100000:2.0:1790391247.692503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391247.692511:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0438b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1877361186317824:12345-0@lo:1000: 00000100:00100000:2.0:1790391247.692650:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0438b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1877361186317824:12345-0@lo:1000: Request processed in 139us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391247.692658:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:1.0:1790391247.693995:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1790391247.694194:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000100:00100000:0.0:1790391247.694628:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001383b39d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1877361186317824:0@lo:1000: 00000040:00080000:0.0:1790391247.694658:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1790391247.694694:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000e77689b8 with version 1 00000004:00080000:3.0:1790391247.695585:0:7457:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000464a1ec5 version 1 rpc_version 1 00000020:00100000:3.0:1790391247.695628:0:7457:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790391247.695638:0:7457:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000be2ea92 x1877361186318080/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391247.695672:0:7457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000be2ea92 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1877361186318080:0@lo:1000: 00000100:00100000:3.0:1790391247.695758:0:7457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391247.695802:0:7457:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e4c43af going to sleep for 11 seconds 00000100:00100000:3.0:1790391247.695822:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186318080 00000100:00100000:3.0:1790391247.695828:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186318080 00000100:00100000:3.0:1790391247.695864:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391247.695871:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000151faa0e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7457:x1877361186318080:12345-0@lo:1000: 00100000:10000000:1.0:1790391247.698950:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1790391247.699239:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1790391247.699399:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1790391247.699525:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1790391247.699666:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1790391247.703078:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1790391247.703245:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000040:00080000:0.0:1790391247.703483:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790391247.703549:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:1.0:1790391247.703952:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1790391247.704094:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1790391247.704257:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1790391247.704680:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1790391247.704943:0:7442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1790391247.708534:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1790391247.711117:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000151faa0e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7457:x1877361186318080:12345-0@lo:1000: Request processed in 15236us (15350us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790391247.711136:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1790391247.711196:0:7457:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1790391247.711200:0:7457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790391247.711219:0:7457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000be2ea92 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1877361186318080:0@lo:1000: 00000001:00080000:1.0:1790391247.718482:0:7442:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790391247.718525:0:7442:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffab840559f988 00100000:10000000:1.0:1790391247.718534:0:7442:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1790391247.721501:0:7442:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790391247.721540:0:7442:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790391247.721563:0:7442:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790391247.721648:0:7442:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1790391247.722499:0:7442:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391247.722914:0:7442:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1790391247.729837:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790391247.729957:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790391247.729963:0:7466:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1790391247.818516:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391248.839940:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391249.866719:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391250.892923:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391251.912029:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790391252.560344:0:7712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790391252.937027:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391253.000201:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7f0020b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186318464:0@lo:400: 00000100:00100000:2.0:1790391253.000282:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391253.000346:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391253.000352:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1ede30c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186318336:0@lo:400: 00000100:00100000:2.0:1790391253.000381:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391253.000456:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d5f63be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186318208:0@lo:400: 00000100:00100000:0.0:1790391253.000489:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391253.000522:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391253.000527:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a3ea0a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186318592:0@lo:400: 00000100:00100000:0.0:1790391253.000550:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391253.000580:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186318336 00000100:00100000:0.0:1790391253.000588:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186318336 00000100:00100000:0.0:1790391253.000643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186318592 00000100:00100000:0.0:1790391253.000646:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186318592 00000100:00100000:0.0:1790391253.000661:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391253.000704:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d59ca1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186318336:12345-0@lo:400: 00000100:00100000:0.0:1790391253.000756:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d59ca1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186318336:12345-0@lo:400: Request processed in 78us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391253.000763:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391253.000779:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391253.000796:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001383b39d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186318592:12345-0@lo:400: 00000100:00100000:0.0:1790391253.000830:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001383b39d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186318592:12345-0@lo:400: Request processed in 35us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391253.000836:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790391253.000871:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002a3ea0a9 x1877361186318592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391253.000910:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a3ea0a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186318592:0@lo:400: 00010000:00080000:0.0:1790391253.000942:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b1ede30c x1877361186318336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391253.000951:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1ede30c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186318336:0@lo:400: 00000100:00100000:2.0:1790391253.001023:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186318208 00000100:00100000:2.0:1790391253.001028:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186318208 00000100:00100000:2.0:1790391253.001069:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790391253.001075:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e715e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:3640:x1877361186318208:12345-0@lo:400: 00000100:00100000:2.0:1790391253.001106:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e715e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:3640:x1877361186318208:12345-0@lo:400: Request processed in 32us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391253.001112:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790391253.001244:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186318464 00000100:00100000:3.0:1790391253.001248:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186318464 00000100:00100000:3.0:1790391253.001274:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391253.001280:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bb6d9d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186318464:12345-0@lo:400: 00000100:00100000:3.0:1790391253.001324:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bb6d9d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186318464:12345-0@lo:400: Request processed in 44us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391253.001330:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391253.001363:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7f0020b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186318464:0@lo:400: 00000100:00100000:0.0:1790391253.001514:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000be2ea92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186318720:0@lo:41: 00000100:00100000:0.0:1790391253.001543:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391253.001574:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d5f63be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186318208:0@lo:400: 00000100:00100000:3.0:1790391253.001757:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186318720 00000100:00100000:3.0:1790391253.001771:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186318720 00000100:00100000:3.0:1790391253.001799:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790391253.001806:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c709a3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186318720:12345-0@lo:41: 00000004:00000024:3.0:1790391253.001832:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1790391253.001905:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c709a3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186318720:12345-0@lo:41: Request processed in 99us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391253.001911:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391253.002846:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000be2ea92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186318720:0@lo:41: 00000020:00000004:1.0:1790391253.708472:0:7764:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391253.708765:0:7764:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790391253.963363:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391254.985623:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391256.008990:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790391256.071967:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790391256.071986:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e52b5eaa800 from 4 10000000:01000000:2.0:1790391256.071990:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391256.072030:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391256.072040:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391256.072047:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0c38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391256.072064:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000481ec885 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186318848:0@lo:101: 00000100:00100000:2.0:1790391256.072129:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391256.073275:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000924604b2 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.073398:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186318848 00000100:00100000:0.0:1790391256.073408:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186318848 00000100:00100000:0.0:1790391256.073501:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790391256.073510:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000306bfb10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:6509:x1877361186318848:12345-0@lo:101: 00010000:00010000:0.0:1790391256.073526:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391256.073544:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005fa0e299/0x2b1b7949f13e0c3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0c38 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.073572:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005fa0e299/0x2b1b7949f13e0c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c38 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.073601:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005fa0e299/0x2b1b7949f13e0c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c38 expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.073609:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005fa0e299, rc 0) 00000100:00100000:0.0:1790391256.073685:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000306bfb10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:6509:x1877361186318848:12345-0@lo:101: Request processed in 177us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.073693:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790391256.076359:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000481ec885 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186318848:0@lo:101: 00010000:00010000:0.0:1790391256.076392:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0c38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.076480:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0c38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391256.079463:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d8a3861 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186318976:0@lo:256: 00000100:00100000:0.0:1790391256.079560:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391256.079756:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186318976 00000100:00100000:2.0:1790391256.079766:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186318976 00000100:00100000:2.0:1790391256.079827:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391256.079835:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033297f49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:6509:x1877361186318976:12345-0@lo:256: 20000000:01000000:2.0:1790391256.079856:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790391256.079897:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790391256.079901:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1790391256.079992:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033297f49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:6509:x1877361186318976:12345-0@lo:256: Request processed in 158us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391256.080000:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790391256.081767:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014f66fad going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.081805:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d8a3861 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186318976:0@lo:256: 10000000:01000000:3.0:1790391256.081952:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391256.081963:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0c38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391256.081974:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 00000000d2bf0067/0x2b1b7949f13e0c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391256.081983:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790391256.081985:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5289da8000 from 21 10000000:01000000:3.0:1790391256.081988:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391256.082021:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 0000000098169a9f/0x2b1b7949f13e0c46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391256.082029:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 0000000098169a9f/0x2b1b7949f13e0c46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391256.082037:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 0000000098169a9f/0x2b1b7949f13e0c46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391256.082054:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004263c1bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186319104:0@lo:101: 00000100:00100000:3.0:1790391256.082108:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391256.082148:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000009848aea9 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.082215:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186319104 00000100:00100000:0.0:1790391256.082221:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186319104 00000100:00100000:0.0:1790391256.082287:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790391256.082294:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000651b52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:6509:x1877361186319104:12345-0@lo:101: 00010000:00010000:0.0:1790391256.082305:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391256.082317:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000482d6837/0x2b1b7949f13e0c4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.082352:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000482d6837/0x2b1b7949f13e0c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c46 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.082362:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000482d6837/0x2b1b7949f13e0c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c46 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.082370:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000482d6837, rc 0) 00000100:00100000:0.0:1790391256.082416:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000651b52bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186319104:12345-0@lo:101: Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.082422:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790391256.082512:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004263c1bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186319104:0@lo:101: 00010000:00010000:3.0:1790391256.082532:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 0000000098169a9f/0x2b1b7949f13e0c46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391256.082540:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 0000000098169a9f/0x2b1b7949f13e0c46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391256.082591:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004263c1bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186319232:0@lo:501: 00000100:00100000:3.0:1790391256.082628:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391256.082660:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000009848aea9 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.082713:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186319232 00000100:00100000:0.0:1790391256.082717:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186319232 00000100:00100000:0.0:1790391256.082746:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790391256.082752:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010be1621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186319232:12345-0@lo:501: 00000100:00100000:0.0:1790391256.082869:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010be1621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186319232:12345-0@lo:501: Request processed in 117us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.082897:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790391256.082926:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004263c1bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186319232:0@lo:501: 00000100:00100000:0.0:1790391256.082951:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186319360:0@lo:503: 00000100:00100000:0.0:1790391256.082991:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391256.083010:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000565b4d92 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.083022:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186319360 00000100:00100000:0.0:1790391256.083025:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186319360 00000100:00100000:0.0:1790391256.083043:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790391256.083048:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071b076b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186319360:12345-0@lo:503: 00000100:00100000:0.0:1790391256.083123:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071b076b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186319360:12345-0@lo:503: Request processed in 75us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.083138:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790391256.083174:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186319360:0@lo:503: 00000100:00100000:0.0:1790391256.083369:0:7835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7835:1877361186319488:0@lo:502: 00000100:00100000:0.0:1790391256.083401:0:7835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391256.083419:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186319488 00000100:00100000:0.0:1790391256.083422:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186319488 00000100:00100000:0.0:1790391256.083440:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790391256.083445:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000599a9960 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7835:x1877361186319488:12345-0@lo:502: 00000100:00100000:0.0:1790391256.083515:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000599a9960 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7835:x1877361186319488:12345-0@lo:502: Request processed in 70us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.083522:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790391256.083550:0:7835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1ec18f5 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.083561:0:7835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7835:1877361186319488:0@lo:502: 00000100:00100000:0.0:1790391256.083597:0:7835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7835:1877361186319616:0@lo:502: 00000100:00100000:0.0:1790391256.083630:0:7835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391256.083649:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186319616 00000100:00100000:0.0:1790391256.083665:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186319616 00000100:00100000:0.0:1790391256.083683:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790391256.083688:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b319251e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7835:x1877361186319616:12345-0@lo:502: 00000100:00100000:0.0:1790391256.083743:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b319251e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:7835:x1877361186319616:12345-0@lo:502: Request processed in 56us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.083750:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790391256.083776:0:7835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1ec18f5 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.083787:0:7835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7835:1877361186319616:0@lo:502: 00000040:00080000:0.0:1790391256.083804:0:7835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1790391256.083859:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1790391256.083897:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790391256.083903:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 0000000098169a9f/0x2b1b7949f13e0c46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.083910:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 0000000098169a9f/0x2b1b7949f13e0c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391256.083919:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790391256.083921:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5289da8000 from 4 10000000:01000000:0.0:1790391256.083923:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790391256.083940:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000f56e3edc/0x2b1b7949f13e0c54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.083947:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000f56e3edc/0x2b1b7949f13e0c54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.083955:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000f56e3edc/0x2b1b7949f13e0c54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391256.083966:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186319744:0@lo:101: 00000100:00100000:0.0:1790391256.083993:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391256.084017:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1ec18f5 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.084031:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186319744 00000100:00100000:0.0:1790391256.084034:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186319744 00000100:00100000:0.0:1790391256.084050:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790391256.084055:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ed9bf3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186319744:12345-0@lo:101: 00010000:00010000:0.0:1790391256.084062:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391256.084071:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009cc1de1d/0x2b1b7949f13e0c5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0c54 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084097:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009cc1de1d/0x2b1b7949f13e0c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c54 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084106:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009cc1de1d/0x2b1b7949f13e0c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c54 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084114:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009cc1de1d, rc 0) 00000100:00100000:0.0:1790391256.084145:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ed9bf3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186319744:12345-0@lo:101: Request processed in 90us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.084151:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790391256.084176:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186319744:0@lo:101: 00010000:00010000:0.0:1790391256.084187:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000f56e3edc/0x2b1b7949f13e0c54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084194:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000f56e3edc/0x2b1b7949f13e0c54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391256.084233:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186319872:0@lo:256: 00000100:00100000:0.0:1790391256.084262:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391256.084275:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1ec18f5 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.084286:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186319872 00000100:00100000:0.0:1790391256.084289:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186319872 00000100:00100000:0.0:1790391256.084304:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790391256.084309:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077c98f83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186319872:12345-0@lo:256: 20000000:01000000:0.0:1790391256.084321:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790391256.084334:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790391256.084338:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1790391256.084410:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077c98f83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186319872:12345-0@lo:256: Request processed in 101us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.084417:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790391256.084444:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186319872:0@lo:256: 10000000:01000000:0.0:1790391256.084480:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790391256.084484:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000f56e3edc/0x2b1b7949f13e0c54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084490:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 00000000f56e3edc/0x2b1b7949f13e0c54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391256.084497:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790391256.084498:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1790391256.084500:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790391256.084528:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 0000000081abdf2c/0x2b1b7949f13e0c62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084535:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 0000000081abdf2c/0x2b1b7949f13e0c62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084542:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 0000000081abdf2c/0x2b1b7949f13e0c62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391256.084553:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186320000:0@lo:101: 00000100:00100000:0.0:1790391256.084576:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391256.084591:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1ec18f5 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.084604:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186320000 00000100:00100000:0.0:1790391256.084607:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186320000 00000100:00100000:0.0:1790391256.084624:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790391256.084631:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002973c248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186320000:12345-0@lo:101: 00010000:00010000:0.0:1790391256.084644:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391256.084666:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3733a33/0x2b1b7949f13e0c69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0c62 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084680:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3733a33/0x2b1b7949f13e0c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c62 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084687:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3733a33/0x2b1b7949f13e0c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c62 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084694:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3733a33, rc 0) 00000100:00100000:0.0:1790391256.084723:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002973c248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186320000:12345-0@lo:101: Request processed in 93us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.084729:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790391256.084756:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186320000:0@lo:101: 00010000:00010000:0.0:1790391256.084765:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 0000000081abdf2c/0x2b1b7949f13e0c62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391256.084773:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 0000000081abdf2c/0x2b1b7949f13e0c62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391256.084816:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186320128:0@lo:501: 00000100:00100000:0.0:1790391256.084842:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391256.084856:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1ec18f5 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.084867:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186320128 00000100:00100000:0.0:1790391256.084870:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186320128 00000100:00100000:0.0:1790391256.088723:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790391256.088737:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f1f35e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186320128:12345-0@lo:501: 00000100:00100000:0.0:1790391256.089498:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f1f35e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186320128:12345-0@lo:501: Request processed in 762us (4653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.089510:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790391256.096602:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082285d6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186320128:0@lo:501: 00000100:00100000:1.0:1790391256.096675:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000380dbd19 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186320256:0@lo:503: 00000100:00100000:1.0:1790391256.096775:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.096815:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ec8af52 going to sleep for 11 seconds 00000100:00100000:1.0:1790391256.096844:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186320256 00000100:00100000:1.0:1790391256.096850:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186320256 00000100:00100000:1.0:1790391256.096915:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790391256.096922:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2240eac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186320256:12345-0@lo:503: 00000100:00100000:1.0:1790391256.097037:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2240eac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186320256:12345-0@lo:503: Request processed in 115us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391256.097044:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790391256.097094:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000380dbd19 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186320256:0@lo:503: 00000100:00100000:1.0:1790391256.097540:0:7836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000380dbd19 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7836:1877361186320384:0@lo:502: 00000100:00100000:1.0:1790391256.097580:0:7836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.097609:0:7836:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063729840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391256.097916:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186320384 00000100:00100000:3.0:1790391256.097922:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186320384 00000100:00100000:3.0:1790391256.097956:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790391256.097963:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001abc4969 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:7836:x1877361186320384:12345-0@lo:502: 00000100:00100000:3.0:1790391256.098057:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001abc4969 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:7836:x1877361186320384:12345-0@lo:502: Request processed in 94us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391256.098063:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790391256.098545:0:7836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000380dbd19 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7836:1877361186320384:0@lo:502: 00000020:01000000:1.0:1790391256.098575:0:7836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391256.098586:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391256.098589:0:7836:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1790391256.098662:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790391256.098666:0:7836:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:00000080:1.0:1790391256.098690:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391256.098706:0:7836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000007564f5b3) 00000020:00000080:1.0:1790391256.098734:0:7836:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1790391256.098740:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790391256.098836:0:7836:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1790391256.098842:0:7836:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790391256.098848:0:7836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e0c77 00010000:00080000:1.0:1790391256.098874:0:7836:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000018137787@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:1.0:1790391256.103377:0:7836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1790391256.106169:0:7836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790391256.106182:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790391256.106222:0:7836:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790391256.106246:0:7836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e0c7e 00000100:00080000:1.0:1790391256.106256:0:7836:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391256.106261:0:7836:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000018137787 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391256.106295:0:7836:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000380dbd19 x1877361186320512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391256.106355:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000380dbd19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186320512:0@lo:38: 00000100:00100000:3.0:1790391256.106425:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790391256.106486:0:7836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790391256.106517:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186320512 00000100:00100000:0.0:1790391256.106525:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186320512 00000100:00100000:0.0:1790391256.106564:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391256.106571:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060c31735 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186320512:12345-0@lo:38: 00000040:01000000:1.0:1790391256.106585:0:7836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00010000:00080000:0.0:1790391256.106608:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1790391256.106645:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e0c85 00000004:00100000:0.0:1790391256.106670:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1790391256.106675:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1790391256.107570:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000481ec885 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186320640:0@lo:400: 00000100:00100000:0.0:1790391256.107635:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391256.107682:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d5f63be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186320768:0@lo:400: 00000100:00100000:0.0:1790391256.107699:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391256.107709:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7f0020b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186320896:0@lo:400: 00000100:00100000:3.0:1790391256.107721:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.107774:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186320640 00000100:00100000:1.0:1790391256.107780:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186320640 00000100:00100000:0.0:1790391256.107820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.107825:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391256.107836:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075931e60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186320640:12345-0@lo:400: 00000100:00100000:1.0:1790391256.107909:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075931e60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186320640:12345-0@lo:400: Request processed in 76us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391256.107916:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391256.107928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186320896 00000100:00100000:1.0:1790391256.107931:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186320896 00000100:00100000:1.0:1790391256.107944:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391256.107949:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e9a70f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186320896:12345-0@lo:400: 00000100:00100000:1.0:1790391256.107977:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e9a70f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186320896:12345-0@lo:400: Request processed in 29us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391256.107983:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790391256.108014:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b7f0020b x1877361186320896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391256.108026:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7f0020b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186320896:0@lo:400: 00000100:00080000:1.0:1790391256.108146:0:7839:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000002f996a30 x1877361186321024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391256.108156:0:7839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de0bd565 going to sleep for 0 seconds 00000100:00100000:3.0:1790391256.108221:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1790391256.108228:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:0.0:1790391256.108393:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000481ec885 x1877361186320640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391256.108404:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000481ec885 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186320640:0@lo:400: 00000020:01000000:0.0:1790391256.108476:0:7836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391256.108495:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391256.108498:0:7836:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1790391256.108503:0:7836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391256.108508:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391256.108510:0:7836:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790391256.108514:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790391256.108517:0:7836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790391256.108547:0:7836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004ed030a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7836:1877361186321152:0@lo:502: 00000100:00100000:0.0:1790391256.108606:0:7836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391256.108643:0:7836:0:(client.c:2716:ptlrpc_set_wait()) set 000000009286a9fa going to sleep for 11 seconds 00000100:00100000:3.0:1790391256.108703:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186320768 00000100:00100000:3.0:1790391256.108709:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186320768 00000100:00100000:1.0:1790391256.108769:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186321152 00000100:00100000:1.0:1790391256.108773:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186321152 00000100:00100000:1.0:1790391256.108804:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790391256.108811:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7d9f2a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:7836:x1877361186321152:12345-0@lo:502: 00000100:00100000:1.0:1790391256.108940:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7d9f2a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:7836:x1877361186321152:12345-0@lo:502: Request processed in 129us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391256.108947:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790391256.109055:0:7836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004ed030a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:7836:1877361186321152:0@lo:502: 00000020:01000000:0.0:1790391256.109078:0:7836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391256.109083:0:7836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391256.109085:0:7836:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790391256.109088:0:7836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1790391256.109133:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391256.109142:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004263c1bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186320768:12345-0@lo:400: 00000100:00100000:2.0:1790391256.109194:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004263c1bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186320768:12345-0@lo:400: Request processed in 54us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391256.109201:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391256.109267:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d5f63be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186320768:0@lo:400: 00000020:01000000:1.0:1790391256.109353:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1790391256.109376:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790391256.109383:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 0000000081abdf2c/0x2b1b7949f13e0c62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391256.109394:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 0000000081abdf2c/0x2b1b7949f13e0c62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391256.109403:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790391256.109405:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e52ae8c99c0 from 1 10000000:01000000:1.0:1790391256.109408:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790391256.109432:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000053ff0a9/0x2b1b7949f13e0c8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391256.109440:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000053ff0a9/0x2b1b7949f13e0c8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391256.109449:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000053ff0a9/0x2b1b7949f13e0c8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391256.109472:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b53493f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186321280:0@lo:101: 00000100:00100000:1.0:1790391256.109498:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.109525:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000005685bff4 going to sleep for 11 seconds 00000100:00100000:2.0:1790391256.109619:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186321280 00000100:00100000:2.0:1790391256.109624:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186321280 00000100:00100000:2.0:1790391256.109660:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790391256.109667:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f4db0dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186321280:12345-0@lo:101: 00010000:00010000:2.0:1790391256.109675:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391256.109686:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004bd77483/0x2b1b7949f13e0c93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0c8c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391256.109707:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004bd77483/0x2b1b7949f13e0c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c8c expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391256.109716:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004bd77483/0x2b1b7949f13e0c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c8c expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391256.109724:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004bd77483, rc 0) 00000100:00100000:2.0:1790391256.109832:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f4db0dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186321280:12345-0@lo:101: Request processed in 165us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391256.109838:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790391256.110641:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b53493f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186321280:0@lo:101: 00010000:00010000:3.0:1790391256.110666:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000053ff0a9/0x2b1b7949f13e0c8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391256.110687:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000053ff0a9/0x2b1b7949f13e0c8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391256.110750:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000be2ea92 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186321408:0@lo:501: 00000100:00100000:3.0:1790391256.110786:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391256.110821:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000179bb4d1 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.110869:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186321408 00000100:00100000:0.0:1790391256.110875:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186321408 00000100:00100000:0.0:1790391256.110936:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790391256.110944:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afd5ea6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186321408:12345-0@lo:501: 00000100:00100000:0.0:1790391256.111018:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afd5ea6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186321408:12345-0@lo:501: Request processed in 76us (233us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391256.111026:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790391256.111050:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000be2ea92 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186321408:0@lo:501: 10000000:01000000:3.0:1790391256.111075:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790391256.111080:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: 00000000053ff0a9/0x2b1b7949f13e0c8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391256.111088:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: 00000000053ff0a9/0x2b1b7949f13e0c8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790391256.122047:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000b92976c7 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391256.122158:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060c31735 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1877361186320512:12345-0@lo:38: Request processed in 15584us (15731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.122169:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790391256.122360:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391256.122372:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790391256.122380:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1790391256.122385:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790391256.122387:0:3636:0:(import.c:65:import_set_state_nolock()) 0000000018137787 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1790391256.122405:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000de0bd565): req@000000002f996a30 x1877361186321024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391256.122420:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000380dbd19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186320512:0@lo:38: 00000100:00100000:1.0:1790391256.122488:0:7839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.122525:0:7839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de0bd565 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.123970:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391256.123989:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004ed030a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186321536:0@lo:41: 00000100:00100000:0.0:1790391256.124046:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.124133:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186321024 00000100:00100000:1.0:1790391256.124142:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186321024 00000100:00100000:1.0:1790391256.124185:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186321536 00000100:00100000:1.0:1790391256.124189:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186321536 00000100:00100000:1.0:1790391256.124203:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391256.124210:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000380dbd19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7839:x1877361186321024:12345-0@lo:1000: 00000100:00100000:1.0:1790391256.124296:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000380dbd19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7839:x1877361186321024:12345-0@lo:1000: Request processed in 85us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391256.124303:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391256.124335:0:7839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f996a30 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186321024:0@lo:1000: 00000040:01000000:1.0:1790391256.124369:0:7839:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1790391256.124397:0:7839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f996a30 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186321664:0@lo:1000: 00000100:00100000:1.0:1790391256.124444:0:7839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.124454:0:7839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de0bd565 going to sleep for 11 seconds 00000100:00100000:1.0:1790391256.124468:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186321664 00000100:00100000:1.0:1790391256.124470:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186321664 00000100:00100000:1.0:1790391256.124487:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391256.124492:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cda8f632 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3639:x1877361186321536:12345-0@lo:41: 00000004:00000024:1.0:1790391256.124513:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790391256.124737:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cda8f632 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3639:x1877361186321536:12345-0@lo:41: Request processed in 245us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391256.124745:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391256.124757:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790391256.124763:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c91c50c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7839:x1877361186321664:12345-0@lo:1000: 00000100:00100000:1.0:1790391256.124873:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c91c50c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7839:x1877361186321664:12345-0@lo:1000: Request processed in 109us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391256.124900:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790391256.124923:0:7839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f996a30 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186321664:0@lo:1000: 00000100:00100000:1.0:1790391256.124964:0:7839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f996a30 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186321792:0@lo:700: 00000100:00100000:1.0:1790391256.124989:0:7839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.125008:0:7839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e132cce3 going to sleep for 11 seconds 00000100:00100000:3.0:1790391256.126049:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186321792 00000100:00100000:3.0:1790391256.126058:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186321792 00000100:00100000:3.0:1790391256.126103:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391256.126110:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000363bdcc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7839:x1877361186321792:12345-0@lo:700: 00000100:00100000:3.0:1790391256.126177:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000363bdcc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7839:x1877361186321792:12345-0@lo:700: Request processed in 68us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391256.126184:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391256.126557:0:7839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f996a30 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186321792:0@lo:700: 00000100:00100000:1.0:1790391256.126734:0:7839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f996a30 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186321920:0@lo:1000: 00000100:00100000:1.0:1790391256.126773:0:7839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.126793:0:7839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aeceba8f going to sleep for 11 seconds 00000100:00100000:1.0:1790391256.126865:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186321920 00000100:00100000:1.0:1790391256.126869:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186321920 00000100:00100000:1.0:1790391256.126924:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391256.126937:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b53493f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7839:x1877361186321920:12345-0@lo:1000: 00000100:00100000:1.0:1790391256.126996:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b53493f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7839:x1877361186321920:12345-0@lo:1000: Request processed in 59us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391256.127022:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004ed030a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186321536:0@lo:41: 00000100:00100000:1.0:1790391256.127279:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391256.127308:0:7839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f996a30 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186321920:0@lo:1000: 00000004:00080000:1.0:1790391256.127384:0:7839:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000e132cce3 with version 0 00000020:00100000:1.0:1790391256.127399:0:7839:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790391256.127406:0:7839:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002f996a30 x1877361186322176/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391256.127419:0:7839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f996a30 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186322176:0@lo:1000: 00000100:00100000:1.0:1790391256.127444:0:7839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391256.127514:0:7839:0:(client.c:2716:ptlrpc_set_wait()) set 0000000027e15145 going to sleep for 11 seconds 00000100:00100000:1.0:1790391256.127537:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186322176 00000100:00100000:1.0:1790391256.127541:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186322176 00000100:00100000:0.0:1790391256.128800:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391256.128814:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dd9dda5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7839:x1877361186322176:12345-0@lo:1000: 00000001:00080000:0.0:1790391256.139129:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1790391256.139147:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790391256.146257:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dd9dda5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7839:x1877361186322176:12345-0@lo:1000: Request processed in 17440us (18804us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790391256.146270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1790391256.146389:0:7839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1790391256.146394:0:7839:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790391256.146411:0:7839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f996a30 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186322176:0@lo:1000: 00000100:00100000:3.0:1790391256.146508:0:7839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000be2ea92 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186322304:0@lo:1000: 00000100:00100000:3.0:1790391256.146560:0:7839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391256.146604:0:7839:0:(client.c:2716:ptlrpc_set_wait()) set 000000009848aea9 going to sleep for 11 seconds 00000100:00100000:1.0:1790391256.146615:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186322304 00000100:00100000:1.0:1790391256.146623:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186322304 00000100:00100000:1.0:1790391256.146686:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391256.146693:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041bc58a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7839:x1877361186322304:12345-0@lo:1000: 00000100:00100000:1.0:1790391256.146766:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041bc58a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7839:x1877361186322304:12345-0@lo:1000: Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391256.146770:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391256.146873:0:7839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000be2ea92 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7839:1877361186322304:0@lo:1000: 00000040:00080000:3.0:1790391256.146925:0:7839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1790391256.146952:0:7839:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000179bb4d1 with version 1 00000004:00080000:0.0:1790391256.147206:0:7837:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000007c54ced8 version 1 rpc_version 1 00000020:00100000:0.0:1790391256.147228:0:7837:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1790391256.147236:0:7837:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004ed030a6 x1877361186322560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391256.147251:0:7837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004ed030a6 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7837:1877361186322560:0@lo:1000: 00000100:00100000:0.0:1790391256.147282:0:7837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391256.147301:0:7837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000592a1ac0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391256.149026:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186322560 00000100:00100000:0.0:1790391256.149042:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186322560 00000100:00100000:1.0:1790391256.149824:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391256.149837:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa5a0d01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7837:x1877361186322560:12345-0@lo:1000: 00000040:00080000:3.0:1790391256.149900:0:7839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790391256.149965:0:7839:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790391256.149971:0:7839:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1790391256.159668:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1790391256.159903:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa5a0d01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7837:x1877361186322560:12345-0@lo:1000: Request processed in 10065us (12617us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790391256.159914:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1790391256.159989:0:7837:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1790391256.159994:0:7837:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790391256.160010:0:7837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004ed030a6 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7837:1877361186322560:0@lo:1000: 00000020:00000004:3.0:1790391256.673435:0:7871:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391256.673773:0:7871:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790391257.038133:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790391257.593297:0:7920:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2422b7f0 20000000:00000080:1.0:1790391257.593325:0:7920:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e52b750f400 uarg=0000000000000000 20000000:01000000:1.0:1790391257.593383:0:7920:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790391257.593392:0:7920:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790391257.593398:0:7920:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790391257.593502:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1790391257.593517:0:7920:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1790391257.598054:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391257.598424:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790391257.598465:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1790391257.598483:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1790391257.598506:0:7920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790391257.598529:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391257.598555:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f2f5bb09/0x2b1b7949f13e0b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b12 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391257.598563:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000297613c4/0x2b1b7949f13e0c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c00 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391257.598571:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391257.598625:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000297613c4/0x2b1b7949f13e0c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0c00 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391257.598670:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000297613c4/0x2b1b7949f13e0c07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c00 expref: 17 pid: 6505 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391257.598690:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1877361186322688:0@lo:104: 00000100:00100000:1.0:1790391257.598779:0:7920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790391257.599100:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f2f5bb09/0x2b1b7949f13e0b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0b12 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391257.599108:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f2f5bb09/0x2b1b7949f13e0b19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b12 expref: 17 pid: 6506 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391257.599116:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ab1e233 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1877361186322816:0@lo:104: 00000100:00100000:1.0:1790391257.599136:0:7920:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ec8af52 going to sleep for 11 seconds 00000100:00100000:2.0:1790391257.601329:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790391257.601401:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391257.601443:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186322688 00000100:00100000:2.0:1790391257.601454:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186322688 00000100:00100000:2.0:1790391257.601510:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186322816 00000100:00100000:2.0:1790391257.601513:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186322816 00000100:00100000:2.0:1790391257.601527:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391257.601535:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee9fce94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:7920:x1877361186322688:12345-0@lo:104: 00010000:00010000:2.0:1790391257.601558:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.601668:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391257.601682:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee9fce94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:7920:x1877361186322688:12345-0@lo:104: Request processed in 148us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391257.601690:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391257.601737:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391257.601742:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1ede30c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:7920:x1877361186322816:12345-0@lo:104: 00010000:00010000:2.0:1790391257.601750:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.601795:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391257.601800:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1ede30c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:7920:x1877361186322816:12345-0@lo:104: Request processed in 58us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391257.601805:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1790391257.601828:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391257.601834:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.601841:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000933b42ee already unused, calling callback (000000000b92e0f5) 10000000:00010000:2.0:1790391257.601844:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.601852:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391257.601859:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391257.601865:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790391257.601932:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.601949:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391257.601971:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.601978:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: 00000000933b42ee/0x2b1b7949f13e0c00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c07 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.601993:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391257.601996:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.602002:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d137c0d8 already unused, calling callback (000000000b92e0f5) 10000000:00010000:2.0:1790391257.602004:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.602010:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391257.602016:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391257.602021:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790391257.602034:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.602040:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391257.602043:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.602049:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: 00000000d137c0d8/0x2b1b7949f13e0b12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b19 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391257.602071:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391257.602073:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391257.602075:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391257.602081:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391257.602179:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a448a152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186322944:0@lo:103: 00000100:00100000:0.0:1790391257.602226:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391257.602285:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391257.602292:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e12a1dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186323072:0@lo:103: 00000100:00100000:0.0:1790391257.602313:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391257.602445:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1877361186322688:0@lo:104: 00000100:00100000:1.0:1790391257.602458:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ab1e233 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1877361186322816:0@lo:104: 00010000:00010000:1.0:1790391257.602486:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391257.602768:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186322944 00000100:00100000:3.0:1790391257.602777:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186322944 00010000:00010000:3.0:1790391257.602806:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000297613c4/0x2b1b7949f13e0c07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c00 expref: 18 pid: 6505 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391257.602841:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186323072 00000100:00100000:3.0:1790391257.602844:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186323072 00010000:00010000:3.0:1790391257.602855:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f2f5bb09/0x2b1b7949f13e0b19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b12 expref: 19 pid: 6506 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391257.602867:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391257.602873:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ed030a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:3637:x1877361186322944:12345-0@lo:103: 00010000:00010000:3.0:1790391257.602905:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391257.602910:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000297613c4/0x2b1b7949f13e0c07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c00 expref: 19 pid: 6505 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.602921:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000297613c4/0x2b1b7949f13e0c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c00 expref: 19 pid: 6505 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.602938:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000297613c4/0x2b1b7949f13e0c07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0c00 expref: 19 pid: 6505 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.602962:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391257.603021:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ed030a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:3637:x1877361186322944:12345-0@lo:103: Request processed in 148us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391257.603028:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391257.603045:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391257.603050:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9a6204d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:3637:x1877361186323072:12345-0@lo:103: 00010000:00010000:3.0:1790391257.603058:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391257.603062:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f2f5bb09/0x2b1b7949f13e0b19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b12 expref: 17 pid: 6506 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603070:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f2f5bb09/0x2b1b7949f13e0b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b12 expref: 17 pid: 6506 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603079:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f2f5bb09/0x2b1b7949f13e0b19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0b12 expref: 17 pid: 6506 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603090:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603098:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603122:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603129:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603135:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603147:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603158:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007bae652f already unused, calling callback (000000002575b2ae) 00010000:00010000:3.0:1790391257.603162:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603170:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603183:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391257.603193:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391257.603217:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9a6204d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:3637:x1877361186323072:12345-0@lo:103: Request processed in 166us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391257.603223:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391257.603253:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e12a1dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186323072:0@lo:103: 00000100:00100000:3.0:1790391257.603261:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a448a152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186322944:0@lo:103: 00010000:00010000:1.0:1790391257.603985:0:7920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391257.603998:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391257.604005:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007bae652f/0x2b1b7949f13e0c9a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391258.057229:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391258.120123:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000be2ea92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186323200:0@lo:41: 00000100:00100000:0.0:1790391258.120402:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391258.120781:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186323200 00000100:00100000:3.0:1790391258.120793:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186323200 00000100:00100000:3.0:1790391258.120980:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391258.120992:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082285d6e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186323200:12345-0@lo:41: 00000004:00000024:3.0:1790391258.121043:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1790391258.121175:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082285d6e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186323200:12345-0@lo:41: Request processed in 184us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391258.121183:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790391258.121375:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000be2ea92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186323200:0@lo:41: 00010000:00010000:2.0:1790391259.080046:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391260.112014:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391261.128911:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391261.201091:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ab1e233 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186323328:0@lo:41: 00000100:00100000:2.0:1790391261.201202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391261.201531:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186323328 00000100:00100000:1.0:1790391261.201543:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186323328 00000100:00100000:1.0:1790391261.201617:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790391261.201628:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000241bdc39 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186323328:12345-0@lo:41: 00000004:00000024:1.0:1790391261.201677:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790391261.201740:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000241bdc39 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186323328:12345-0@lo:41: Request processed in 114us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391261.201748:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790391261.201844:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186323456:0@lo:400: 00000100:00100000:1.0:1790391261.201902:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391261.201930:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391261.201936:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0bd1baa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186323584:0@lo:400: 00000100:00100000:1.0:1790391261.201964:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391261.201997:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186323584 00000100:00100000:1.0:1790391261.202001:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186323584 00000100:00100000:1.0:1790391261.202030:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391261.202037:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b566455a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186323584:12345-0@lo:400: 00000100:00100000:1.0:1790391261.202075:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b566455a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186323584:12345-0@lo:400: Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391261.202082:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790391261.202127:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f0bd1baa x1877361186323584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391261.202142:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0bd1baa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186323584:0@lo:400: 00000100:00100000:2.0:1790391261.204582:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006951d4a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186323840:0@lo:400: 00000100:00100000:2.0:1790391261.204687:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391261.204772:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ab1e233 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186323328:0@lo:41: 00000100:00100000:2.0:1790391261.204801:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391261.204807:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006f61dd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186323712:0@lo:400: 00000100:00100000:2.0:1790391261.204835:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391261.204898:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186323456 00000100:00100000:2.0:1790391261.204907:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186323456 00000100:00100000:2.0:1790391261.204965:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391261.204975:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5925df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:3637:x1877361186323456:12345-0@lo:400: 00000100:00100000:2.0:1790391261.205036:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5925df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:3637:x1877361186323456:12345-0@lo:400: Request processed in 62us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391261.205043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391261.205083:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186323840 00000100:00100000:2.0:1790391261.205087:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186323840 00000100:00100000:2.0:1790391261.205114:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391261.205121:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a3ea0a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186323840:12345-0@lo:400: 00000100:00100000:2.0:1790391261.205171:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a3ea0a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186323840:12345-0@lo:400: Request processed in 51us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391261.205177:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391261.205195:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186323712 00000100:00100000:2.0:1790391261.205198:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186323712 00000100:00100000:2.0:1790391261.205221:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790391261.205226:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d72731ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186323712:12345-0@lo:400: 00000100:00100000:2.0:1790391261.205258:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d72731ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186323712:12345-0@lo:400: Request processed in 32us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391261.205264:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790391261.205292:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2880dd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186323456:0@lo:400: 00000100:00100000:2.0:1790391261.205319:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006f61dd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186323712:0@lo:400: 00010000:00080000:2.0:1790391261.205329:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006951d4a7 x1877361186323840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391261.205340:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006951d4a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186323840:0@lo:400: 00010000:00010000:0.0:1790391262.153754:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391263.187310:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391263.241524:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c708a52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186323968:0@lo:41: 00000100:00100000:2.0:1790391263.241637:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391263.244955:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186323968 00000100:00100000:3.0:1790391263.244978:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186323968 00000100:00100000:3.0:1790391263.245055:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790391263.245066:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000644fdf1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186323968:12345-0@lo:41: 00000004:00000024:3.0:1790391263.245120:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1790391263.257205:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000644fdf1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186323968:12345-0@lo:41: Request processed in 12125us (15552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391263.257228:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391263.257621:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c708a52 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186323968:0@lo:41: 00010000:00010000:0.0:1790391264.202464:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391265.225902:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790391265.800018:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391265.800027:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b5eaa800 from 1 10000000:01000000:0.0:1790391265.800030:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391265.800086:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: 00000000a5b56712/0x2b1b7949f13e0ca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391265.800111:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: 00000000a5b56712/0x2b1b7949f13e0ca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391265.800122:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: 00000000a5b56712/0x2b1b7949f13e0ca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391265.800155:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d8a3861 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324096:0@lo:101: 00000100:00100000:0.0:1790391265.800213:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391265.800267:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000007a5f2665 going to sleep for 11 seconds 00000100:00100000:3.0:1790391265.800387:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186324096 00000100:00100000:3.0:1790391265.800396:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186324096 00000100:00100000:3.0:1790391265.800454:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790391265.800460:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c471ceab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186324096:12345-0@lo:101: 00010000:00010000:3.0:1790391265.800472:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391265.800483:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ef2ca91/0x2b1b7949f13e0ca8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0ca1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.800500:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ef2ca91/0x2b1b7949f13e0ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ca1 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.800507:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ef2ca91/0x2b1b7949f13e0ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ca1 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.800513:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ef2ca91, rc 0) 00000100:00100000:3.0:1790391265.800547:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c471ceab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186324096:12345-0@lo:101: Request processed in 87us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391265.800552:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790391265.800607:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d8a3861 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324096:0@lo:101: 00010000:00010000:3.0:1790391265.800619:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: 00000000a5b56712/0x2b1b7949f13e0ca1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.800633:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: 00000000a5b56712/0x2b1b7949f13e0ca1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391265.800683:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ac89477 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324224:0@lo:501: 00000100:00100000:3.0:1790391265.800703:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391265.800717:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b1a217a going to sleep for 11 seconds 00000100:00100000:3.0:1790391265.800731:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186324224 00000100:00100000:3.0:1790391265.800734:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186324224 00000100:00100000:3.0:1790391265.800754:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790391265.800760:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b5b3843 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186324224:12345-0@lo:501: 00000100:00100000:3.0:1790391265.800847:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b5b3843 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186324224:12345-0@lo:501: Request processed in 88us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391265.800852:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790391265.800872:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ac89477 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324224:0@lo:501: 00000100:00100000:3.0:1790391265.800909:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ac89477 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324352:0@lo:503: 00000100:00100000:3.0:1790391265.800936:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391265.800945:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092200053 going to sleep for 11 seconds 00000100:00100000:3.0:1790391265.800953:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186324352 00000100:00100000:3.0:1790391265.800955:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186324352 00000100:00100000:3.0:1790391265.800968:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391265.800971:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c3b3cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186324352:12345-0@lo:503: 00000100:00100000:3.0:1790391265.801023:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c3b3cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186324352:12345-0@lo:503: Request processed in 52us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391265.801028:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391265.801056:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ac89477 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324352:0@lo:503: 00000100:00100000:3.0:1790391265.801223:0:8307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ac89477 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8307:1877361186324480:0@lo:502: 00000100:00100000:3.0:1790391265.801250:0:8307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391265.801268:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186324480 00000100:00100000:3.0:1790391265.801271:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186324480 00000100:00100000:3.0:1790391265.801290:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790391265.801295:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5a286a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:8307:x1877361186324480:12345-0@lo:502: 00000100:00100000:3.0:1790391265.801352:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5a286a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:8307:x1877361186324480:12345-0@lo:502: Request processed in 57us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391265.801359:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790391265.801385:0:8307:0:(client.c:2716:ptlrpc_set_wait()) set 00000000897d61e1 going to sleep for 11 seconds 00000100:00100000:3.0:1790391265.801396:0:8307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ac89477 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8307:1877361186324480:0@lo:502: 00000020:01000000:3.0:1790391265.801415:0:8307:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391265.801422:0:8307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391265.801425:0:8307:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790391265.801431:0:8307:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52b5eaa800 00000020:00000080:3.0:1790391265.801433:0:8307:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790391265.801463:0:8307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8307:1877361186324608:0@lo:502: 00000100:00100000:3.0:1790391265.801487:0:8307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391265.801500:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186324608 00000100:00100000:3.0:1790391265.801502:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186324608 00000100:00100000:3.0:1790391265.801515:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790391265.801519:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:8307:x1877361186324608:12345-0@lo:502: 00000100:00100000:3.0:1790391265.801557:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:8307:x1877361186324608:12345-0@lo:502: Request processed in 37us (69us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391265.801575:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790391265.801603:0:8307:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bff780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391265.801614:0:8307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8307:1877361186324608:0@lo:502: 00000020:01000000:3.0:1790391265.801636:0:8307:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391265.801639:0:8307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391265.801640:0:8307:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790391265.801642:0:8307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1790391265.801681:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790391265.801692:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391265.801697:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeec00/0x2b1b7949f13e0ca1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.801703:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeec00/0x2b1b7949f13e0ca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391265.801711:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391265.801713:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5289da8000 from 1 10000000:01000000:3.0:1790391265.801716:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391265.801733:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.801740:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.801748:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391265.801759:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324736:0@lo:101: 00000100:00100000:3.0:1790391265.801780:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391265.801789:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bff780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391265.801797:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186324736 00000100:00100000:3.0:1790391265.801799:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186324736 00000100:00100000:3.0:1790391265.801812:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391265.801815:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186324736:12345-0@lo:101: 00010000:00010000:3.0:1790391265.801824:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391265.801833:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e0cb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.801843:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e0cb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0caf expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.801849:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e0cb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0caf expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.801853:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144a00, rc 0) 00000100:00100000:3.0:1790391265.801872:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186324736:12345-0@lo:101: Request processed in 57us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391265.801892:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391265.801913:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324736:0@lo:101: 00010000:00010000:3.0:1790391265.801920:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.801925:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391265.801948:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324864:0@lo:501: 00000100:00100000:3.0:1790391265.801963:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391265.801971:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bff780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391265.801977:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186324864 00000100:00100000:3.0:1790391265.801979:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186324864 00000100:00100000:3.0:1790391265.801991:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391265.801994:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186324864:12345-0@lo:501: 00000100:00100000:3.0:1790391265.802049:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186324864:12345-0@lo:501: Request processed in 53us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391265.802055:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391265.802081:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324864:0@lo:501: 00000100:00100000:3.0:1790391265.802101:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324992:0@lo:503: 00000100:00100000:3.0:1790391265.802129:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391265.802138:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290bff780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391265.802145:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186324992 00000100:00100000:3.0:1790391265.802147:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186324992 00000100:00100000:3.0:1790391265.802160:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790391265.802163:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186324992:12345-0@lo:503: 00000100:00100000:3.0:1790391265.802204:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186324992:12345-0@lo:503: Request processed in 40us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391265.802208:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790391265.802233:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186324992:0@lo:503: 00000100:00100000:3.0:1790391265.802395:0:8308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8308:1877361186325120:0@lo:502: 00000100:00100000:3.0:1790391265.802425:0:8308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391265.802439:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186325120 00000100:00100000:3.0:1790391265.802441:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186325120 00000100:00100000:3.0:1790391265.802454:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391265.802457:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:8308:x1877361186325120:12345-0@lo:502: 00000100:00100000:3.0:1790391265.802500:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:8308:x1877361186325120:12345-0@lo:502: Request processed in 41us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391265.802504:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391265.802522:0:8308:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391265.802533:0:8308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8308:1877361186325120:0@lo:502: 00000020:01000000:3.0:1790391265.802545:0:8308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391265.802548:0:8308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391265.802549:0:8308:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790391265.802553:0:8308:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5289da8000 00000020:00000080:3.0:1790391265.802554:0:8308:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790391265.802583:0:8308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8308:1877361186325248:0@lo:502: 00000100:00100000:3.0:1790391265.802613:0:8308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391265.802631:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186325248 00000100:00100000:3.0:1790391265.802634:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186325248 00000100:00100000:3.0:1790391265.802648:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790391265.802651:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:8308:x1877361186325248:12345-0@lo:502: 00000100:00100000:3.0:1790391265.802688:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:8308:x1877361186325248:12345-0@lo:502: Request processed in 36us (76us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391265.802692:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790391265.802713:0:8308:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528916e600 going to sleep for 11 seconds 00000100:00100000:3.0:1790391265.802725:0:8308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8308:1877361186325248:0@lo:502: 00000020:01000000:3.0:1790391265.802740:0:8308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391265.802744:0:8308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391265.802746:0:8308:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790391265.802749:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1790391265.802776:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790391265.802785:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391265.802789:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391265.802795:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391266.248124:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391266.312113:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391266.312139:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186325376:0@lo:41: 00000100:00100000:2.0:1790391266.312211:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391266.312274:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186325376 00000100:00100000:2.0:1790391266.312282:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186325376 00000100:00100000:2.0:1790391266.312330:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391266.312339:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186325376:12345-0@lo:41: 00000004:00000024:2.0:1790391266.312387:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1790391266.312449:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186325376:12345-0@lo:41: Request processed in 110us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391266.312456:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391266.312500:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186325376:0@lo:41: 00000100:00100000:2.0:1790391266.319623:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186325504:0@lo:400: 00000100:00100000:2.0:1790391266.319681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391266.319720:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391266.319724:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186325632:0@lo:400: 00000100:00100000:2.0:1790391266.319740:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391266.319766:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186325504 00000100:00100000:2.0:1790391266.319772:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186325504 00000100:00100000:2.0:1790391266.319810:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391266.319815:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186325504:12345-0@lo:400: 00000100:00100000:2.0:1790391266.319857:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186325504:12345-0@lo:400: Request processed in 41us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391266.319864:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391266.319908:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186325632 00000100:00100000:2.0:1790391266.319911:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186325632 00000100:00100000:2.0:1790391266.319929:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790391266.319933:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186325632:12345-0@lo:400: 00000100:00100000:2.0:1790391266.319956:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186325632:12345-0@lo:400: Request processed in 24us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391266.319960:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790391266.319985:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186325632:0@lo:400: 00010000:00080000:2.0:1790391266.319993:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5292338380 x1877361186325504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391266.320011:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186325504:0@lo:400: 00000100:00100000:2.0:1790391266.320031:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186325760:0@lo:400: 00000100:00100000:2.0:1790391266.320048:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391266.320066:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186325760 00000100:00100000:2.0:1790391266.320068:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186325760 00000100:00100000:2.0:1790391266.320082:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391266.320086:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186325760:12345-0@lo:400: 00000100:00100000:2.0:1790391266.320106:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186325760:12345-0@lo:400: Request processed in 19us (57us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391266.320109:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1790391266.320126:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e529233a680 x1877361186325760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391266.320132:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186325760:0@lo:400: 00010000:00010000:0.0:1790391267.272639:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790391267.598261:0:8420:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790391267.598265:0:8420:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790391267.598267:0:8420:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790391267.598400:0:8420:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e52b77e2800 00000020:01000004:3.0:1790391267.598415:0:8420:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790391267.598426:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790391267.598447:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e529e978000) 00000020:00000080:3.0:1790391267.598462:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790391267.651307:0:8420:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1790391267.651365:0:8420:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1790391267.679660:0:8420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790391267.679851:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790391267.679864:0:8420:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790391267.680097:0:8420:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2b1b7949f13e0cc4 00000020:01000004:2.0:1790391267.680106:0:8420:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790391267.680137:0:8420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790391267.680141:0:8420:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790391267.680148:0:8420:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790391267.680153:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790391267.680177:0:8420:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e52b9d73380) 00000020:00000080:2.0:1790391267.680190:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1790391267.687656:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391267.687842:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790391267.687854:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790391267.700371:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790391267.700389:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790391267.700782:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790391267.700789:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790391267.703801:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391267.704303:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790391267.704309:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790391267.706358:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790391267.706372:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790391267.734335:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391267.734679:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790391267.734687:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790391267.736338:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790391267.736350:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790391267.741772:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790391267.741791:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790391267.745818:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391267.746426:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790391267.746433:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790391267.747508:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790391267.747518:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1790391267.810736:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391267.811235:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1790391267.811243:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790391267.812727:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790391267.812739:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790391267.813575:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790391267.813609:0:8420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1790391267.813616:0:8420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790391267.833635:0:8420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790391267.833673:0:8420:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.128@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790391267.833678:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790391267.833680:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790391267.833681:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391267.833682:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391267.833683:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391267.833684:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391267.833685:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391267.833687:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391267.833688:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391267.833689:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391267.833690:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391267.833694:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790391267.833696:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391267.833697:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790391267.833698:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391267.833699:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391267.833701:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391267.833702:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391267.833702:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391267.833703:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391267.833704:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391267.833709:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391267.833710:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391267.833735:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790391267.833753:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186325888:0@lo:253: 00000100:00100000:2.0:1790391267.835234:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391267.835414:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5283d16480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391267.835463:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186325888 00000100:00100000:3.0:1790391267.835472:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186325888 00000100:00100000:3.0:1790391267.835584:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790391267.835594:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:8420:x1877361186325888:12345-0@lo:253: 20000000:01000000:3.0:1790391267.835626:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790391267.835631:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1790391267.835636:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1790391267.835639:0:6507:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1790391267.835947:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391267.836105:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1790391267.836135:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1790391267.836153:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1790391267.836159:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1790391267.836172:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1790391267.836184:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1790391267.836261:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1790391267.836277:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.128@tcp 20000000:01000000:3.0:1790391267.836279:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.128@tcp (null) (null) (null) 00000040:00080000:3.0:1790391267.836368:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1790391267.836376:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790391267.836391:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1790391267.836397:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.128@tcp (null) (null) 00000040:00080000:3.0:1790391267.836409:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1790391267.836416:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790391267.836429:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1790391267.836446:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1790391267.836512:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1790391267.836524:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.128@tcp 20000000:01000000:3.0:1790391267.836526:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.128@tcp (null) (null) (null) 00000040:00080000:3.0:1790391267.836540:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1790391267.836560:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790391267.836574:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1790391267.836579:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.128@tcp (null) (null) 00000040:00080000:3.0:1790391267.836591:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1790391267.836596:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790391267.836608:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1790391267.836622:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1790391267.836994:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1790391267.837006:0:6507:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.128@tcp 20000000:01000000:3.0:1790391267.837007:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.128@tcp (null) (null) (null) 00000040:00080000:3.0:1790391267.837018:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1790391267.837034:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1790391267.837050:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1790391267.837055:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.128@tcp (null) (null) 00000040:00080000:3.0:1790391267.837066:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1790391267.837072:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1790391267.837084:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1790391267.837098:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1790391267.837110:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790391267.837112:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790391267.837116:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790391267.837156:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790391267.837159:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790391267.838403:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1790391267.838444:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1790391267.838461:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1790391267.838665:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1790391267.838688:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1790391267.838703:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1790391267.838712:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790391267.838715:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790391267.839414:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1790391267.839595:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1790391267.839617:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1790391267.839632:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1790391267.839642:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790391267.839646:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790391267.840600:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1790391267.840633:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1790391267.840649:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1790391267.840831:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1790391267.840852:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1790391267.840865:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1790391267.841372:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1790391267.841376:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790391267.841675:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1790391267.841718:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1790391267.841749:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1790391267.842220:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1790391267.842238:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1790391267.842251:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:2.0:1790391267.842264:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790391267.842283:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.842362:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0b97 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.842371:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c0e expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.842378:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c46 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.842394:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e0c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c62 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.842401:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c8c expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.842408:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.842444:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0c8c expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.842458:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0c93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c8c expref: 18 pid: 6505 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.842472:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1877361186326016:0@lo:104: 00000100:00100000:2.0:1790391267.842532:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391267.842626:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e0c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0c62 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.842634:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e0c69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c62 expref: 18 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.842642:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1877361186326144:0@lo:104: 00000100:00100000:2.0:1790391267.842662:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391267.842735:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0c46 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.842743:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0c4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c46 expref: 18 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.842757:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1877361186326272:0@lo:104: 00000100:00100000:2.0:1790391267.842778:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391267.842821:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186326016 00000100:00100000:0.0:1790391267.842828:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186326016 00000100:00100000:0.0:1790391267.842859:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186326144 00000100:00100000:0.0:1790391267.842861:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186326144 00000100:00100000:0.0:1790391267.842873:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391267.842917:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6507:x1877361186326016:12345-0@lo:104: 00010000:00010000:0.0:1790391267.842931:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6600/0x2b1b7949f13e0c8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.842978:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790391267.842984:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6507:x1877361186326016:12345-0@lo:104: Request processed in 76us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.842990:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391267.843028:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391267.843035:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6507:x1877361186326144:12345-0@lo:104: 00010000:00010000:0.0:1790391267.843042:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e0c62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843073:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790391267.843077:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6507:x1877361186326144:12345-0@lo:104: Request processed in 44us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.843082:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1790391267.843097:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391267.843102:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6600/0x2b1b7949f13e0c8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843109:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f6600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391267.843113:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6600/0x2b1b7949f13e0c8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843121:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6600/0x2b1b7949f13e0c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391267.843138:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6600/0x2b1b7949f13e0c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391267.843144:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391267.843169:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6600/0x2b1b7949f13e0c8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843175:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391267.843191:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6600/0x2b1b7949f13e0c8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843206:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6600/0x2b1b7949f13e0c8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c93 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843219:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391267.843222:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e0c62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843228:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391267.843231:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e0c62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843238:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391267.843244:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391267.843249:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391267.843260:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e0c62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843265:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391267.843277:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e0c62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843284:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e0c62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843301:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391267.843307:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391267.843309:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391267.843328:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186326400:0@lo:103: 00000100:00100000:0.0:1790391267.843354:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391267.843385:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186326528:0@lo:103: 00000100:00100000:0.0:1790391267.843404:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391267.843431:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186326400 00000100:00100000:0.0:1790391267.843434:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186326400 00010000:00010000:0.0:1790391267.843449:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0c93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c8c expref: 19 pid: 6505 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391267.843466:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186326528 00000100:00100000:0.0:1790391267.843469:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186326528 00010000:00010000:0.0:1790391267.843476:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e0c69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c62 expref: 20 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391267.843486:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391267.843492:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:3638:x1877361186326400:12345-0@lo:103: 00010000:00010000:0.0:1790391267.843511:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391267.843517:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0c93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c8c expref: 20 pid: 6505 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843527:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0c93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c8c expref: 20 pid: 6505 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843554:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391267.843585:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:3638:x1877361186326400:12345-0@lo:103: Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.843591:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391267.843603:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391267.843615:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:3639:x1877361186326528:12345-0@lo:103: 00010000:00010000:0.0:1790391267.843623:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391267.843627:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e0c69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c62 expref: 19 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843635:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e0c69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c62 expref: 19 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.843644:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391267.843667:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:3639:x1877361186326528:12345-0@lo:103: Request processed in 54us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.843672:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391267.843706:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186326400:0@lo:103: 00000100:00100000:0.0:1790391267.843726:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186326528:0@lo:103: 00010000:00010000:1.0:1790391267.844398:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391267.846487:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0c0e expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.846503:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0c15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c0e expref: 18 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.846518:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1877361186326656:0@lo:104: 00000100:00100000:2.0:1790391267.846575:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391267.846714:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0b97 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.846722:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0b9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b97 expref: 18 pid: 6505 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.846730:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1877361186326784:0@lo:104: 00000100:00100000:2.0:1790391267.846752:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.846768:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186326272 00000100:00100000:3.0:1790391267.846774:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186326272 00000100:00100000:3.0:1790391267.846807:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186326656 00000100:00100000:3.0:1790391267.846809:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186326656 00000100:00100000:3.0:1790391267.846820:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391267.846827:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6507:x1877361186326272:12345-0@lo:104: 00010000:00010000:3.0:1790391267.846839:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295144c00/0x2b1b7949f13e0c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391267.846956:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790391267.846962:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6507:x1877361186326272:12345-0@lo:104: Request processed in 135us (4183us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391267.846968:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391267.846983:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391267.846989:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6507:x1877361186326656:12345-0@lo:104: 00010000:00010000:3.0:1790391267.846996:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5280031400/0x2b1b7949f13e0c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391267.847029:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790391267.847034:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6507:x1877361186326656:12345-0@lo:104: Request processed in 46us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391267.847039:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1790391267.847229:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391267.847235:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295144c00/0x2b1b7949f13e0c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847243:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144c00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391267.847247:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144c00/0x2b1b7949f13e0c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847256:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295144c00/0x2b1b7949f13e0c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391267.847264:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144c00/0x2b1b7949f13e0c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391267.847269:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391267.847308:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295144c00/0x2b1b7949f13e0c46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847315:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391267.847332:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295144c00/0x2b1b7949f13e0c46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847339:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295144c00/0x2b1b7949f13e0c46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c4d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847349:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391267.847352:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280031400/0x2b1b7949f13e0c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847367:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391267.847370:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031400/0x2b1b7949f13e0c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847377:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280031400/0x2b1b7949f13e0c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391267.847383:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031400/0x2b1b7949f13e0c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391267.847388:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391267.847399:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5280031400/0x2b1b7949f13e0c0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847405:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391267.847415:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280031400/0x2b1b7949f13e0c0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847422:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280031400/0x2b1b7949f13e0c0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c15 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847430:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391267.847432:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391267.847433:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391267.847444:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186326912:0@lo:103: 00000100:00100000:1.0:1790391267.847473:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391267.847502:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186327040:0@lo:103: 00000100:00100000:1.0:1790391267.847519:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391267.847565:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186326912 00000100:00100000:1.0:1790391267.847570:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186326912 00010000:00010000:1.0:1790391267.847585:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0c4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c46 expref: 19 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391267.847603:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186327040 00000100:00100000:1.0:1790391267.847605:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186327040 00010000:00010000:1.0:1790391267.847613:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0c15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c0e expref: 20 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391267.847623:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391267.847628:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:3640:x1877361186326912:12345-0@lo:103: 00010000:00010000:1.0:1790391267.847636:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391267.847640:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0c4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c46 expref: 20 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847651:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0c4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c46 expref: 20 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847665:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391267.847687:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:3640:x1877361186326912:12345-0@lo:103: Request processed in 59us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391267.847692:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391267.847703:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391267.847707:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:3637:x1877361186327040:12345-0@lo:103: 00010000:00010000:1.0:1790391267.847713:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391267.847717:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0c15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c0e expref: 19 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847725:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0c15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c0e expref: 19 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.847738:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391267.847762:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:3637:x1877361186327040:12345-0@lo:103: Request processed in 54us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391267.847768:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1790391267.847786:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391267.847805:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186327040:0@lo:103: 00000100:00100000:1.0:1790391267.847823:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186326912:0@lo:103: 00000100:00100000:2.0:1790391267.848536:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1790391267.848563:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0c93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0c8c expref: 18 pid: 6505 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.848575:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1877361186326016:0@lo:104: 00010000:00010000:2.0:1790391267.848584:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e0c69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0c62 expref: 17 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.848591:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1877361186326144:0@lo:104: 00010000:00010000:2.0:1790391267.848599:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0c4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0c46 expref: 16 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.848615:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1877361186326272:0@lo:104: 00010000:00010000:2.0:1790391267.848624:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0c0e expref: 15 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.848631:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1877361186326656:0@lo:104: 00000100:00100000:3.0:1790391267.848674:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186326784 00000100:00100000:3.0:1790391267.848679:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186326784 00000100:00100000:3.0:1790391267.848711:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391267.848718:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6507:x1877361186326784:12345-0@lo:104: 00010000:00010000:3.0:1790391267.848730:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391267.848832:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790391267.848838:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6507:x1877361186326784:12345-0@lo:104: Request processed in 120us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391267.848844:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1790391267.849247:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391267.849254:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.849261:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031a00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391267.849265:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.849274:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391267.849282:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391267.849287:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391267.850168:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.850178:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391267.850205:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0b97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.850228:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0b9e expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.850247:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391267.850249:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391267.850251:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391267.850260:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391267.850275:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186327168:0@lo:103: 00000100:00100000:1.0:1790391267.850502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391267.850582:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186327168 00000100:00100000:0.0:1790391267.850590:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186327168 00010000:00010000:0.0:1790391267.850617:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0b9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b97 expref: 15 pid: 6505 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391267.850652:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391267.850661:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae98b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3637:x1877361186327168:12345-0@lo:103: 00010000:00010000:0.0:1790391267.850672:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391267.850678:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0b9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b97 expref: 15 pid: 6505 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850690:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0b9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0b97 expref: 15 pid: 6505 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850707:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850722:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850737:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850745:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850752:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850759:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850765:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566d600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391267.850769:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850778:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850787:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.850797:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391267.850843:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae98b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3637:x1877361186327168:12345-0@lo:103: Request processed in 183us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.850849:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391267.851016:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186327168:0@lo:103: 00010000:00010000:2.0:1790391267.851470:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0b97 expref: 14 pid: 6505 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.851484:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6507:1877361186326784:0@lo:104: 00010000:00010000:2.0:1790391267.851512:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.851568:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.851576:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.851582:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0cd2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790391267.851594:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790391267.854610:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:8420:x1877361186325888:12345-0@lo:253: Request processed in 19007us (19372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391267.854625:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790391267.854707:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186325888:0@lo:253: 10000000:01000000:0.0:1790391267.854734:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790391267.854738:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391267.854740:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391267.854741:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391267.854742:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1790391267.854743:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391267.854744:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391267.854745:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391267.854747:0:8420:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790391267.854749:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391267.854751:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790391267.854769:0:8420:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e52b77e2800 from lustre-OST0000 10000000:01000000:0.0:1790391267.854799:0:8420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790391267.854802:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790391267.854811:0:8420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e52ae8c99c0 local copy 10000000:01000000:0.0:1790391267.854815:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790391267.855483:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.855496:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.855505:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391267.855524:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186327296:0@lo:101: 00000100:00100000:1.0:1790391267.855766:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391267.855841:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.856253:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186327296 00000100:00100000:0.0:1790391267.856260:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186327296 00000100:00100000:0.0:1790391267.856371:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790391267.856382:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+13:8420:x1877361186327296:12345-0@lo:101: 00010000:00010000:0.0:1790391267.856394:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391267.856409:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0cd9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.856432:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0cd9 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.856443:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0cd9 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.856451:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef600, rc 0) 00000100:00100000:0.0:1790391267.856500:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186327296:12345-0@lo:101: Request processed in 120us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.856518:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790391267.856611:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186327296:0@lo:101: 00010000:00010000:2.0:1790391267.856626:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.856643:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.856746:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186327424:0@lo:501: 00000100:00100000:2.0:1790391267.856774:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391267.856806:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.857223:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186327424 00000100:00100000:0.0:1790391267.857229:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186327424 00000100:00100000:0.0:1790391267.857258:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790391267.857265:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186327424:12345-0@lo:501: 00000100:00100000:0.0:1790391267.857420:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186327424:12345-0@lo:501: Request processed in 155us (645us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391267.857427:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790391267.857617:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186327424:0@lo:501: 10000000:01000000:2.0:1790391267.857633:0:8420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790391267.857654:0:8420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790391267.857660:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.857669:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.857677:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.857702:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790391267.857728:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e52b77e2800 10000000:01000000:2.0:1790391267.857733:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790391267.857740:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790391267.857742:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391267.857746:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790391267.857749:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790391267.857769:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.857786:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.857793:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.857807:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186327552:0@lo:101: 00000100:00100000:2.0:1790391267.857833:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391267.857851:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b466c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790391267.857917:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391267.857923:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.857930:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f7400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391267.857933:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.857941:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391267.857947:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391267.857953:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391267.857971:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.857977:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391267.857997:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.858014:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0cd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2b1b7949f13e0ce0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.858208:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391267.858210:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391267.858211:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391267.858221:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186327552 00000100:00100000:0.0:1790391267.858226:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186327552 00000100:00100000:0.0:1790391267.858249:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790391267.858256:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186327552:12345-0@lo:101: 00010000:00010000:0.0:1790391267.858263:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391267.858274:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0cee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0ce7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.858359:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ce7 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.858370:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ce7 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.858377:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee800, rc 0) 00000100:00100000:0.0:1790391267.858408:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186327552:12345-0@lo:101: Request processed in 153us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.858415:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790391267.858551:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391267.858571:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186327680:0@lo:103: 00000100:00100000:3.0:1790391267.858602:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391267.858689:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186327552:0@lo:101: 00010000:00010000:2.0:1790391267.858700:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391267.858709:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391267.858771:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186327808:0@lo:501: 00000100:00100000:2.0:1790391267.858795:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391267.858819:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391267.858862:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186327808 00000100:00100000:3.0:1790391267.858867:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186327808 00000100:00100000:3.0:1790391267.858925:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391267.858933:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186327808:12345-0@lo:501: 00000100:00100000:3.0:1790391267.859237:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186327808:12345-0@lo:501: Request processed in 303us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391267.859244:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790391267.859379:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186327680 00000100:00100000:0.0:1790391267.859384:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186327680 00000100:00100000:0.0:1790391267.859412:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391267.859418:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3640:x1877361186327680:12345-0@lo:103: 00010000:00010000:0.0:1790391267.859437:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391267.859450:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0ce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0cd9 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.859462:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391267.859503:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:3640:x1877361186327680:12345-0@lo:103: Request processed in 84us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.859510:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391267.859595:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186327808:0@lo:501: 00000100:00100000:2.0:1790391267.859625:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186327936:0@lo:503: 00000100:00100000:2.0:1790391267.859665:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391267.859695:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391267.859747:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186327680:0@lo:103: 00000100:00100000:0.0:1790391267.859801:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186327936 00000100:00100000:0.0:1790391267.859806:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186327936 00000100:00100000:0.0:1790391267.859836:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790391267.859843:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186327936:12345-0@lo:503: 00000100:00100000:0.0:1790391267.860497:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186327936:12345-0@lo:503: Request processed in 652us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.860506:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790391267.860585:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186327936:0@lo:503: 00000040:00080000:2.0:1790391267.860834:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391267.861385:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328064:0@lo:502: 00000100:00100000:3.0:1790391267.861436:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.861476:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.861522:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186328064 00000100:00100000:0.0:1790391267.861529:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186328064 00000100:00100000:0.0:1790391267.861578:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790391267.861589:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186328064:12345-0@lo:502: 00000100:00100000:0.0:1790391267.861684:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186328064:12345-0@lo:502: Request processed in 98us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.861691:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790391267.861849:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328064:0@lo:502: 00000040:00080000:3.0:1790391267.862532:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790391267.862576:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790391267.862591:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790391267.862603:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1790391267.862615:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1790391267.862627:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790391267.862656:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328192:0@lo:502: 00000100:00100000:3.0:1790391267.862700:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.862729:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.862792:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186328192 00000100:00100000:0.0:1790391267.862798:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186328192 00000100:00100000:0.0:1790391267.862835:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790391267.862843:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186328192:12345-0@lo:502: 00000100:00100000:0.0:1790391267.863116:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186328192:12345-0@lo:502: Request processed in 273us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.863141:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790391267.863600:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328192:0@lo:502: 00000040:00080000:3.0:1790391267.863654:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790391267.863664:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1790391267.864392:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790391267.864401:0:8443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1790391267.864407:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391267.864410:0:8443:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790391267.864416:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391267.864431:0:8443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e52b9aacd40) 00000020:00000080:0.0:1790391267.864452:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790391267.864458:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790391267.864540:0:8443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52b77e2800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790391267.864563:0:8443:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790391267.864569:0:8443:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2b1b7949f13e0cfc 00010000:00010000:0.0:1790391267.870705:0:8443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1790391267.871509:0:8443:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1790391267.874806:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790391267.875580:0:8443:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1790391267.881412:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1790391267.881620:0:8443:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1790391267.892411:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1790391267.894569:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790391267.894582:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391267.894602:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391267.894604:0:8443:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790391267.894609:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391267.894614:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391267.894615:0:8443:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790391267.894634:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790391267.894636:0:8443:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790391267.894663:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391267.894666:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391267.894667:0:8443:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790391267.894671:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790391267.895389:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790391267.895424:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790391267.895447:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391267.895457:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391267.895465:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b77e2800 from 1 10000000:01000000:3.0:1790391267.895468:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391267.895505:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391267.895513:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391267.895523:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391267.895558:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328320:0@lo:101: 00000100:00100000:3.0:1790391267.895824:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391267.896119:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186328320 00000100:00100000:3.0:1790391267.896206:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.896243:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186328320 00000100:00100000:0.0:1790391267.896360:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790391267.896371:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:8420:x1877361186328320:12345-0@lo:101: 00010000:00010000:0.0:1790391267.896385:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391267.896399:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0d0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0d03 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.896422:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d03 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.896433:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d03 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391267.896450:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef600, rc 0) 00000100:00100000:0.0:1790391267.896505:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186328320:12345-0@lo:101: Request processed in 136us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.896512:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790391267.896672:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328320:0@lo:101: 00010000:00010000:1.0:1790391267.896688:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.896697:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391267.898083:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328448:0@lo:501: 00000100:00100000:1.0:1790391267.898236:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391267.898592:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186328448 00000100:00100000:0.0:1790391267.898599:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186328448 00000100:00100000:0.0:1790391267.898641:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790391267.898648:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186328448:12345-0@lo:501: 00000100:00100000:1.0:1790391267.899176:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f300 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.900325:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186328448:12345-0@lo:501: Request processed in 1672us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.900336:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790391267.914392:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328448:0@lo:501: 00000100:00100000:3.0:1790391267.914458:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328576:0@lo:503: 00000100:00100000:3.0:1790391267.914540:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.914586:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.914679:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186328576 00000100:00100000:0.0:1790391267.914686:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186328576 00000100:00100000:0.0:1790391267.914736:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790391267.914745:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186328576:12345-0@lo:503: 00000100:00100000:0.0:1790391267.914901:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186328576:12345-0@lo:503: Request processed in 133us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.915360:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790391267.916217:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328576:0@lo:503: 00000040:00080000:2.0:1790391267.918367:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391267.918459:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328704:0@lo:502: 00000100:00100000:2.0:1790391267.918559:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391267.918602:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.920230:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186328704 00000100:00100000:0.0:1790391267.920256:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186328704 00000100:00100000:0.0:1790391267.920431:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790391267.920443:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186328704:12345-0@lo:502: 00000100:00100000:0.0:1790391267.920647:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186328704:12345-0@lo:502: Request processed in 206us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.920653:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790391267.921672:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328704:0@lo:502: 00000040:00080000:2.0:1790391267.924200:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790391267.924270:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790391267.924387:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328832:0@lo:502: 00000100:00100000:2.0:1790391267.924469:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391267.924516:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.925581:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186328832 00000100:00100000:0.0:1790391267.925591:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186328832 00000100:00100000:0.0:1790391267.925646:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790391267.925656:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186328832:12345-0@lo:502: 00000100:00100000:0.0:1790391267.925803:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186328832:12345-0@lo:502: Request processed in 147us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.925810:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790391267.926735:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328832:0@lo:502: 00000040:00080000:3.0:1790391267.926824:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790391267.926837:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790391267.929818:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391267.929832:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391267.929835:0:8447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790391267.929844:0:8447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52b77e2800 00000020:00000080:0.0:1790391267.929846:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391267.929858:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391267.929861:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391267.929863:0:8447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790391267.929866:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790391267.934565:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790391267.934600:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391267.934638:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391267.934650:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391267.934707:0:8420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790391267.934710:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e52b77e2800 10000000:01000000:3.0:1790391267.934713:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e52b77e2800 10000000:01000000:3.0:1790391267.934716:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391267.934722:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52b77e2800 from 1 10000000:01000000:3.0:1790391267.934725:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391267.934761:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391267.934770:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391267.934779:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391267.934802:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328960:0@lo:101: 00000100:00100000:3.0:1790391267.934869:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.935210:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391267.936058:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186328960 00000100:00100000:1.0:1790391267.936069:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186328960 00000100:00100000:1.0:1790391267.936120:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790391267.936258:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8420:x1877361186328960:12345-0@lo:101: 00010000:00010000:1.0:1790391267.936275:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391267.936301:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0d18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0d11 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.936328:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d11 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.936340:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d11 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391267.936367:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f7800, rc 0) 00000100:00100000:1.0:1790391267.936423:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186328960:12345-0@lo:101: Request processed in 177us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391267.936430:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790391267.936661:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186328960:0@lo:101: 00010000:00010000:3.0:1790391267.936678:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391267.936687:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391267.936799:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186329088:0@lo:501: 00000100:00100000:3.0:1790391267.936830:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.936859:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.937049:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186329088 00000100:00100000:0.0:1790391267.937054:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186329088 00000100:00100000:0.0:1790391267.937086:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790391267.937092:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186329088:12345-0@lo:501: 00000100:00100000:0.0:1790391267.937429:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186329088:12345-0@lo:501: Request processed in 336us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.937437:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790391267.937583:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186329088:0@lo:501: 00000100:00100000:3.0:1790391267.937612:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186329216:0@lo:503: 00000100:00100000:3.0:1790391267.937656:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.937679:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391267.937800:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186329216 00000100:00100000:1.0:1790391267.937805:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186329216 00000100:00100000:1.0:1790391267.937838:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790391267.937846:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186329216:12345-0@lo:503: 00000100:00100000:1.0:1790391267.939463:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186329216:12345-0@lo:503: Request processed in 1611us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391267.939475:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790391267.939622:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186329216:0@lo:503: 00000040:00080000:3.0:1790391267.940501:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391267.940618:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186329344:0@lo:502: 00000100:00100000:3.0:1790391267.940678:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.940722:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391267.941389:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186329344 00000100:00100000:0.0:1790391267.941397:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186329344 00000100:00100000:0.0:1790391267.941492:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790391267.941502:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186329344:12345-0@lo:502: 00000100:00100000:0.0:1790391267.941652:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186329344:12345-0@lo:502: Request processed in 150us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.941670:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790391267.941814:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186329344:0@lo:502: 00000040:00080000:3.0:1790391267.942087:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790391267.942116:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790391267.942144:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790391267.942159:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790391267.942172:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790391267.942187:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790391267.942201:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790391267.942215:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790391267.942228:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790391267.942254:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790391267.942271:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790391267.942286:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790391267.942312:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790391267.942337:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790391267.942352:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790391267.942365:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790391267.942377:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790391267.942390:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790391267.942402:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790391267.942414:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790391267.942427:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790391267.942438:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790391267.942449:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790391267.942463:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790391267.942476:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1790391267.942489:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1790391267.942501:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1790391267.942513:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1790391267.942525:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1790391267.942538:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1790391267.942564:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1790391267.942577:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1790391267.942586:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1790391267.942597:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1790391267.942608:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1790391267.942621:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1790391267.942633:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1790391267.942670:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186329472:0@lo:502: 00000100:00100000:3.0:1790391267.942727:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.952614:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391267.952688:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186329472 00000100:00100000:2.0:1790391267.952699:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186329472 00000100:00100000:2.0:1790391267.952780:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790391267.952792:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186329472:12345-0@lo:502: 00000100:00100000:2.0:1790391267.953012:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186329472:12345-0@lo:502: Request processed in 222us (10284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391267.953253:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790391267.953672:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186329472:0@lo:502: 00000040:00080000:3.0:1790391267.953763:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1790391267.953776:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1790391267.957274:0:8448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790391267.957478:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e529e97b380) 00000020:00000080:3.0:1790391267.957502:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1790391267.957617:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52b77e2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790391267.957622:0:8448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52b77e2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790391267.957624:0:8448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b77e2800 3 00010000:00080000:3.0:1790391267.957656:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5181f62800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391267.969664:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1790391267.970410:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790391267.970454:0:8448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790391267.970469:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2b1b7949f13e0d26 00000100:00080000:3.0:1790391267.970480:0:8448:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790391267.970487:0:8448:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5181f62800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391267.970523:0:8448:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52b5d04000 x1877361186329600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391267.970557:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790391267.970655:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186329728:0@lo:400: 00000100:00100000:3.0:1790391267.970733:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.970773:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391267.970779:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186330112:0@lo:400: 00000100:00100000:3.0:1790391267.970804:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.970838:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186329856:0@lo:400: 00000100:00100000:3.0:1790391267.970857:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.970900:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391267.973063:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186329600:0@lo:38: 00000100:00100000:0.0:1790391267.973260:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391267.973355:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186329728 00000100:00100000:0.0:1790391267.973362:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186329728 00000100:00100000:0.0:1790391267.973403:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186329600 00000100:00100000:0.0:1790391267.973406:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186329600 00000100:00100000:0.0:1790391267.973420:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391267.973430:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186329728:12345-0@lo:400: 00000100:00100000:0.0:1790391267.973487:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186329728:12345-0@lo:400: Request processed in 59us (2755us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.973494:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391267.973511:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391267.973515:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186329600:12345-0@lo:38: 00010000:00080000:0.0:1790391267.973551:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:0.0:1790391267.973585:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2b1b7949f13e0d2d 00000004:00100000:0.0:1790391267.973599:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790391267.973629:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9e5181cc4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391267.973670:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1877361186329600:12345-0@lo:38: Request processed in 153us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.973677:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790391267.973723:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e52b5d04a80 x1877361186329728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391267.973737:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186329728:0@lo:400: 00010000:00080000:0.0:1790391267.973766:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e52b5d04000 x1877361186329600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391267.973788:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391267.973795:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1790391267.973804:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790391267.973809:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790391267.973811:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5181f62800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790391267.973817:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186329600:0@lo:38: 00000100:00100000:3.0:1790391267.974262:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186329984:0@lo:400: 00000100:00100000:3.0:1790391267.975519:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391267.975598:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186330112 00000100:00100000:3.0:1790391267.975605:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186330112 00000100:00100000:3.0:1790391267.975659:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186329856 00000100:00100000:3.0:1790391267.975671:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186329856 00000100:00100000:3.0:1790391267.975691:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790391267.975698:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186330112:12345-0@lo:400: 00000100:00100000:3.0:1790391267.975755:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186330112:12345-0@lo:400: Request processed in 58us (4949us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391267.975762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790391267.975776:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790391267.975781:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186329856:12345-0@lo:400: 00000100:00100000:3.0:1790391267.975812:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186329856:12345-0@lo:400: Request processed in 31us (4954us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391267.975818:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790391267.975850:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186329856:0@lo:400: 00000100:00100000:0.0:1790391267.976102:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186330112:0@lo:400: 00000100:00100000:0.0:1790391267.977238:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186329984 00000100:00100000:0.0:1790391267.977247:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186329984 00000100:00100000:0.0:1790391267.977505:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391267.977515:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186329984:12345-0@lo:400: 00000100:00100000:0.0:1790391267.977597:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186329984:12345-0@lo:400: Request processed in 84us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391267.977605:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1790391267.977655:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e52b5d06d80 x1877361186329984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391267.977666:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186329984:0@lo:400: 00000020:01000004:3.0:1790391267.997223:0:8448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790391267.997518:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e529e97cd40) 00000020:00000080:3.0:1790391267.997553:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1790391267.997656:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52b77e2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790391267.997661:0:8448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52b77e2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790391267.997664:0:8448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b77e2800 3 00010000:00080000:3.0:1790391267.997693:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5181f61000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391268.011392:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1790391268.011629:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1790391268.011674:0:8448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790391268.011688:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2b1b7949f13e0d3b 00000100:00080000:3.0:1790391268.011700:0:8448:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790391268.011707:0:8448:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e5181f61000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391268.011743:0:8448:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518206d180 x1877361186330240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391268.011784:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790391268.013998:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1877361186330240:0@lo:38: 00000100:00100000:0.0:1790391268.014071:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391268.014162:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186330240 00000100:00100000:0.0:1790391268.014170:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186330240 00000100:00100000:0.0:1790391268.014204:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391268.014212:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186330240:12345-0@lo:38: 00010000:00080000:0.0:1790391268.014241:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:0.0:1790391268.014284:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2b1b7949f13e0d42 00000004:00100000:0.0:1790391268.014310:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790391268.014343:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9e5181cc4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391268.014395:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1877361186330240:12345-0@lo:38: Request processed in 182us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391268.014402:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790391268.014441:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e518206d180 x1877361186330240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391268.014452:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391268.014460:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1790391268.014467:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790391268.014471:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790391268.014473:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5181f61000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790391268.014478:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1877361186330240:0@lo:38: 00000040:00080000:2.0:1790391268.018816:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1790391268.019358:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1790391268.019389:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790391268.019454:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.019468:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790391268.023196:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790391268.023201:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790391268.023202:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391268.023203:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391268.023205:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391268.023206:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391268.023208:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391268.023209:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391268.023211:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391268.023212:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391268.023213:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391268.023220:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1790391268.023223:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391268.023224:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790391268.023225:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391268.023226:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391268.023227:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391268.023228:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391268.023229:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391268.023230:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391268.023231:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391268.023232:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391268.023233:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391268.023259:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790391268.023281:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186330368:0@lo:253: 00000100:00100000:2.0:1790391268.023377:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391268.023424:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7470d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391268.023456:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186330368 00000100:00100000:2.0:1790391268.023463:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186330368 00000100:00100000:2.0:1790391268.023510:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790391268.023518:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186330368:12345-0@lo:253: 20000000:01000000:2.0:1790391268.023556:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790391268.023573:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790391268.036579:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790391268.036599:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790391268.036870:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:8420:x1877361186330368:12345-0@lo:253: Request processed in 13348us (13488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391268.036921:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790391268.036990:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8420:1877361186330368:0@lo:253: 10000000:01000000:0.0:1790391268.037005:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790391268.037008:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391268.037009:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391268.037011:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391268.037011:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391268.037012:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391268.037014:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391268.037016:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391268.037039:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790391268.037040:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790391268.037042:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391268.037044:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790391268.037058:0:8420:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1790391268.040381:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790391268.040392:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790391268.040416:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391268.040434:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e0c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c38 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391268.040442:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0c54 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391268.040449:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391268.040488:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0c54 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391268.040502:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0c5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c54 expref: 15 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391268.040516:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186330496:0@lo:104: 00000100:00100000:3.0:1790391268.040592:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391268.040649:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e0c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0c38 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391268.040656:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e0c3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c38 expref: 15 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391268.040663:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186330624:0@lo:104: 00000100:00100000:3.0:1790391268.040693:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722240 going to sleep for 11 seconds 00000100:00100000:2.0:1790391268.043236:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790391268.044235:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391268.044284:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186330496 00000100:00100000:2.0:1790391268.044448:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186330496 00000100:00100000:2.0:1790391268.044496:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186330624 00000100:00100000:2.0:1790391268.044499:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186330624 00000100:00100000:2.0:1790391268.044516:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391268.044525:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6528:x1877361186330496:12345-0@lo:104: 00010000:00010000:2.0:1790391268.044554:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0c54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.044643:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391268.044649:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6528:x1877361186330496:12345-0@lo:104: Request processed in 126us (4057us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391268.044656:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391268.044701:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391268.044707:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6528:x1877361186330624:12345-0@lo:104: 00010000:00010000:2.0:1790391268.044716:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.044751:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391268.044756:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6528:x1877361186330624:12345-0@lo:104: Request processed in 50us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391268.044762:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1790391268.044778:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391268.044784:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0c54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.044792:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391268.044796:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0c54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.044815:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391268.044822:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391268.044827:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391268.044860:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.044867:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790391268.045096:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186330496:0@lo:104: 00000100:00100000:1.0:1790391268.045107:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186330624:0@lo:104: 00010000:00010000:1.0:1790391268.045160:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.046444:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0c54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.046457:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0c54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c5b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.046469:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391268.046473:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.046479:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566d400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391268.046483:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0c38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.046491:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391268.046498:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0c38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391268.046518:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391268.046559:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0c38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.046566:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391268.046590:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0c38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.046598:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0c38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0c3f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.046612:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391268.046614:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391268.046615:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391268.046627:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391268.046652:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186330752:0@lo:103: 00000100:00100000:2.0:1790391268.046705:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391268.046754:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391268.046761:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186330880:0@lo:103: 00000100:00100000:2.0:1790391268.046783:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391268.046815:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186330752 00000100:00100000:2.0:1790391268.046821:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186330752 00010000:00010000:2.0:1790391268.046845:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0c5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c54 expref: 16 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391268.046867:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186330880 00000100:00100000:2.0:1790391268.046870:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186330880 00010000:00010000:2.0:1790391268.046901:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e0c3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c38 expref: 17 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391268.047947:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391268.047963:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:3640:x1877361186330752:12345-0@lo:103: 00010000:00010000:3.0:1790391268.047978:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391268.047986:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0c5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c54 expref: 17 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391268.047999:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c54 expref: 17 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391268.048013:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0c5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0c54 expref: 17 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391268.048027:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391268.048088:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:3640:x1877361186330752:12345-0@lo:103: Request processed in 130us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391268.048095:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790391268.048233:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186330752:0@lo:103: 00000100:00100000:2.0:1790391268.049284:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391268.049447:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3638:x1877361186330880:12345-0@lo:103: 00010000:00010000:2.0:1790391268.049463:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391268.049469:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e0c3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c38 expref: 15 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.049480:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e0c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0c38 expref: 15 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.049494:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e0c3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0c38 expref: 15 pid: 6507 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.049509:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.049518:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790391268.049534:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012671002s 00010000:00010000:2.0:1790391268.049539:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.049556:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.049562:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.049568:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.049579:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391268.049584:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.049592:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1790391268.051425:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1790391268.051594:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1790391268.051796:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1790391268.052003:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1790391268.052219:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1790391268.052445:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1790391268.058573:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1790391268.063417:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391268.063437:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.064045:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.064058:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295145600/0x2b1b7949f13e0d49 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391268.064083:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391268.064199:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:3638:x1877361186330880:12345-0@lo:103: Request processed in 14753us (17409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391268.064209:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790391268.064407:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186330880:0@lo:103: 00002000:00080000:2.0:1790391268.067960:0:8420:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790391268.067969:0:8420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790391268.068007:0:8420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790391268.068050:0:8420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790391268.068071:0:8420:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790391268.068098:0:8420:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1790391268.075476:0:8420:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391268.075691:0:8420:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1790391268.297048:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391268.363115:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186331008:0@lo:41: 00000100:00100000:0.0:1790391268.363194:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391268.364693:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186331008 00000100:00100000:1.0:1790391268.364706:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186331008 00000100:00100000:1.0:1790391268.364764:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391268.364783:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186331008:12345-0@lo:41: 00000004:00000024:1.0:1790391268.364820:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1790391268.366288:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186331008:12345-0@lo:41: Request processed in 1503us (3089us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391268.366300:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391268.376799:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186331008:0@lo:41: 00000020:00000004:1.0:1790391269.239634:0:8504:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391269.240623:0:8504:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790391269.320416:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391270.344465:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391271.369261:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391271.432546:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391271.432580:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186331136:0@lo:41: 00000100:00100000:1.0:1790391271.432677:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391271.432806:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186331136 00000100:00100000:2.0:1790391271.432819:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186331136 00000100:00100000:2.0:1790391271.432909:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790391271.432923:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186331136:12345-0@lo:41: 00000004:00000024:2.0:1790391271.433002:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1790391271.433071:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186331136:12345-0@lo:41: Request processed in 149us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391271.433081:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790391271.433755:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186331136:0@lo:41: 00010000:00010000:2.0:1790391272.392932:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391273.422412:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391273.487874:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186331264:0@lo:400: 00000100:00100000:0.0:1790391273.487983:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391273.488044:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186331776:0@lo:400: 00000100:00100000:0.0:1790391273.488074:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391273.488101:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391273.488109:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186331648:0@lo:400: 00000100:00100000:0.0:1790391273.488135:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391273.488169:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186331520:0@lo:400: 00000100:00100000:0.0:1790391273.488206:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391273.488226:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186332032:0@lo:400: 00000100:00100000:0.0:1790391273.488247:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391273.488266:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790391273.488272:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186331392:0@lo:400: 00000100:00100000:0.0:1790391273.488292:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391273.488308:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186331904:0@lo:400: 00000100:00100000:0.0:1790391273.488326:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391273.488350:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186331648 00000100:00100000:0.0:1790391273.488358:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186331648 00000100:00100000:0.0:1790391273.488395:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186332032 00000100:00100000:0.0:1790391273.488398:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186332032 00000100:00100000:0.0:1790391273.488423:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186331392 00000100:00100000:0.0:1790391273.488426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186331392 00000100:00100000:0.0:1790391273.488439:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186331904 00000100:00100000:0.0:1790391273.488442:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186331904 00000100:00100000:0.0:1790391273.488457:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391273.488466:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186331648:12345-0@lo:400: 00000100:00100000:0.0:1790391273.488532:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186331648:12345-0@lo:400: Request processed in 67us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391273.488541:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391273.488559:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790391273.488566:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186332032:12345-0@lo:400: 00000100:00100000:0.0:1790391273.488598:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186332032:12345-0@lo:400: Request processed in 33us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391273.488605:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790391273.488617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391273.488623:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186331392:12345-0@lo:400: 00000100:00100000:0.0:1790391273.488658:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186331392:12345-0@lo:400: Request processed in 36us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391273.488665:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790391273.488678:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790391273.488685:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186331904:12345-0@lo:400: 00000100:00100000:0.0:1790391273.488711:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186331904:12345-0@lo:400: Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391273.488717:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1790391273.488755:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52849b8e00 x1877361186331392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391273.488768:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186331392:0@lo:400: 00010000:00080000:0.0:1790391273.488778:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52849bbb80 x1877361186331904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391273.488787:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186331904:0@lo:400: 00010000:00080000:0.0:1790391273.488796:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518229dc00 x1877361186332032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391273.488804:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186332032:0@lo:400: 00010000:00080000:0.0:1790391273.488837:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52849b8a80 x1877361186331648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391273.488845:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186331648:0@lo:400: 00000100:00100000:1.0:1790391273.489028:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186331264 00000100:00100000:1.0:1790391273.489034:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186331264 00000100:00100000:1.0:1790391273.489070:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790391273.489078:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:3640:x1877361186331264:12345-0@lo:400: 00000100:00100000:1.0:1790391273.489120:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:3640:x1877361186331264:12345-0@lo:400: Request processed in 44us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391273.489127:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790391273.489155:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186331776 00000100:00100000:1.0:1790391273.489159:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186331776 00000100:00100000:1.0:1790391273.489182:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186331520 00000100:00100000:1.0:1790391273.489184:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186331520 00000100:00100000:1.0:1790391273.489197:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790391273.489203:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186331776:12345-0@lo:400: 00000100:00100000:1.0:1790391273.489235:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186331776:12345-0@lo:400: Request processed in 32us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391273.489241:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790391273.489261:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790391273.489266:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186331520:12345-0@lo:400: 00000100:00100000:1.0:1790391273.489299:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186331520:12345-0@lo:400: Request processed in 32us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391273.489304:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790391273.489328:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186331520:0@lo:400: 00000100:00100000:1.0:1790391273.489344:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186331264:0@lo:400: 00000100:00100000:1.0:1790391273.489352:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186331776:0@lo:400: 00000100:00100000:2.0:1790391273.489581:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186332160:0@lo:41: 00000100:00100000:2.0:1790391273.489611:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790391273.489659:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391273.489664:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391273.489805:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186332160 00000100:00100000:1.0:1790391273.489810:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186332160 00000100:00100000:1.0:1790391273.489840:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790391273.489846:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186332160:12345-0@lo:41: 00000004:00000024:1.0:1790391273.489871:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1790391273.489928:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186332160:12345-0@lo:41: Request processed in 81us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391273.489934:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790391273.489975:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186332160:0@lo:41: 00010000:00010000:2.0:1790391274.440518:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790391275.334343:0:8794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790391275.467720:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790391276.043110:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790391276.043117:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52b5eaa800 from 30 10000000:01000000:2.0:1790391276.043123:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790391276.043172:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391276.043184:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391276.043194:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391276.043218:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186332288:0@lo:101: 00000100:00100000:2.0:1790391276.043291:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.043354:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5283d16000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391276.043410:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186332288 00000100:00100000:0.0:1790391276.043420:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186332288 00000100:00100000:0.0:1790391276.043504:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790391276.043515:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:6509:x1877361186332288:12345-0@lo:101: 00010000:00010000:0.0:1790391276.043531:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391276.043546:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0d50 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391276.043571:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d50 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391276.043583:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d50 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391276.043593:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee000, rc 0) 00000100:00100000:0.0:1790391276.043660:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186332288:12345-0@lo:101: Request processed in 146us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.043666:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790391276.043732:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186332288:0@lo:101: 00010000:00010000:2.0:1790391276.043747:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391276.043769:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391276.043839:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186332416:0@lo:501: 00000100:00100000:2.0:1790391276.043866:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.043912:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5283d16000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391276.044151:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186332416 00000100:00100000:0.0:1790391276.044155:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186332416 00000100:00100000:0.0:1790391276.044179:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790391276.044184:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186332416:12345-0@lo:501: 00000100:00100000:0.0:1790391276.044304:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186332416:12345-0@lo:501: Request processed in 119us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.044311:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790391276.044347:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186332416:0@lo:501: 00000100:00100000:2.0:1790391276.044374:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186332544:0@lo:503: 00000100:00100000:2.0:1790391276.044420:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.044448:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5283d16000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.044479:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186332544 00000100:00100000:3.0:1790391276.044484:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186332544 00000100:00100000:3.0:1790391276.044520:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790391276.044527:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186332544:12345-0@lo:503: 00000100:00100000:3.0:1790391276.044620:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186332544:12345-0@lo:503: Request processed in 93us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.044627:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790391276.044725:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186332544:0@lo:503: 00000100:00100000:3.0:1790391276.045024:0:8821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8821:1877361186332672:0@lo:502: 00000100:00100000:3.0:1790391276.045133:0:8821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.045158:0:8821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391276.045210:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186332672 00000100:00100000:2.0:1790391276.045215:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186332672 00000100:00100000:0.0:1790391276.045425:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790391276.045434:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8821:x1877361186332672:12345-0@lo:502: 00000100:00100000:0.0:1790391276.045538:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8821:x1877361186332672:12345-0@lo:502: Request processed in 105us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.045545:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790391276.050967:0:8821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8821:1877361186332672:0@lo:502: 00000100:00100000:3.0:1790391276.051144:0:8821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8821:1877361186332800:0@lo:502: 00000100:00100000:3.0:1790391276.051217:0:8821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.051256:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186332800 00000100:00100000:3.0:1790391276.051261:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186332800 00000100:00100000:3.0:1790391276.051303:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790391276.051312:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8821:x1877361186332800:12345-0@lo:502: 00000100:00100000:2.0:1790391276.052514:0:8821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.052651:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:8821:x1877361186332800:12345-0@lo:502: Request processed in 1337us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.052660:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790391276.052765:0:8821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8821:1877361186332800:0@lo:502: 00000040:00080000:2.0:1790391276.052796:0:8821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790391276.053131:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790391276.053156:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790391276.053167:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.053177:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391276.053185:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790391276.053187:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e52b5eaa800 from 5 10000000:01000000:3.0:1790391276.053190:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790391276.053222:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.053229:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.053238:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391276.053268:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186332928:0@lo:101: 00000100:00100000:3.0:1790391276.053304:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.053554:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186332928 00000100:00100000:0.0:1790391276.053560:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186332928 00000100:00100000:0.0:1790391276.053604:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790391276.053612:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186332928:12345-0@lo:101: 00010000:00010000:0.0:1790391276.053622:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391276.053635:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e0d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391276.053656:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e0d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d5e expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391276.053666:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e0d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d5e expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391276.053675:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefa00, rc 0) 00000100:00100000:0.0:1790391276.053705:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186332928:12345-0@lo:101: Request processed in 94us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.053711:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790391276.054447:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.054482:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186332928:0@lo:101: 00010000:00010000:3.0:1790391276.054498:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.054508:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391276.054570:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186333056:0@lo:256: 00000100:00100000:3.0:1790391276.054678:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.054734:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391276.054770:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186333056 00000100:00100000:2.0:1790391276.054775:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186333056 00000100:00100000:2.0:1790391276.054844:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790391276.054852:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186333056:12345-0@lo:256: 20000000:01000000:2.0:1790391276.054867:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790391276.054910:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790391276.054914:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1790391276.054987:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186333056:12345-0@lo:256: Request processed in 136us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391276.055001:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790391276.055077:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186333056:0@lo:256: 10000000:01000000:3.0:1790391276.055121:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391276.055127:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.055135:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391276.055143:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1790391276.055145:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1790391276.055147:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1790391276.055184:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.055200:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.055210:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391276.055221:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186333184:0@lo:101: 00000100:00100000:3.0:1790391276.055244:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.055521:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391276.055744:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186333184 00000100:00100000:0.0:1790391276.055749:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186333184 00000100:00100000:0.0:1790391276.055776:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790391276.055784:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186333184:12345-0@lo:101: 00010000:00010000:0.0:1790391276.055794:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391276.055806:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0d73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391276.055825:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d6c expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391276.055834:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d6c expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391276.055851:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef400, rc 0) 00000100:00100000:0.0:1790391276.056040:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186333184:12345-0@lo:101: Request processed in 257us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.056131:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186333184:0@lo:101: 00010000:00010000:3.0:1790391276.056146:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.056153:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391276.056216:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186333312:0@lo:501: 00000100:00100000:3.0:1790391276.056253:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.056274:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.056287:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186333312 00000100:00100000:3.0:1790391276.056290:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186333312 00000100:00100000:3.0:1790391276.056310:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790391276.056316:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186333312:12345-0@lo:501: 00000100:00100000:0.0:1790391276.056463:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790391276.056780:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186333312:12345-0@lo:501: Request processed in 462us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.056787:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790391276.056986:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186333312:0@lo:501: 00000100:00100000:0.0:1790391276.057034:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186333440:0@lo:503: 00000100:00100000:0.0:1790391276.057160:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.057223:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903c49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391276.057255:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186333440 00000100:00100000:2.0:1790391276.057261:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186333440 00000100:00100000:2.0:1790391276.057444:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790391276.057453:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186333440:12345-0@lo:503: 00000100:00100000:2.0:1790391276.057560:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186333440:12345-0@lo:503: Request processed in 109us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391276.057567:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790391276.057643:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186333440:0@lo:503: 00000100:00100000:0.0:1790391276.058170:0:8822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8822:1877361186333568:0@lo:502: 00000100:00100000:0.0:1790391276.058211:0:8822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.058248:0:8822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903c49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.058293:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186333568 00000100:00100000:3.0:1790391276.058298:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186333568 00000100:00100000:3.0:1790391276.058812:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790391276.058822:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:8822:x1877361186333568:12345-0@lo:502: 00000100:00100000:3.0:1790391276.058963:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:8822:x1877361186333568:12345-0@lo:502: Request processed in 142us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.058969:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790391276.059319:0:8822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8822:1877361186333568:0@lo:502: 00000020:01000000:0.0:1790391276.059541:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790391276.059549:0:8822:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790391276.059557:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391276.059560:0:8822:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790391276.059566:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790391276.059570:0:8822:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:0.0:1790391276.059594:0:8822:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790391276.059609:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391276.059624:0:8822:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e52b9aa99c0) 00000020:00000080:0.0:1790391276.059647:0:8822:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1790391276.059654:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790391276.059753:0:8822:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790391276.059765:0:8822:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790391276.059772:0:8822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e0d81 00010000:00080000:0.0:1790391276.059803:0:8822:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52b5fb1000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:0.0:1790391276.060250:0:8822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1790391276.077109:0:8822:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790391276.077136:0:8822:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1790391276.077390:0:8822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391276.077666:0:8822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391276.078033:0:8822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1790391276.078184:0:8822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1790391276.079954:0:8823:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391276.079961:0:8823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790391276.082264:0:8822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790391276.082279:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790391276.082319:0:8822:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790391276.082460:0:8822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e0d88 00000100:00080000:0.0:1790391276.082481:0:8822:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391276.082489:0:8822:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e52b5fb1000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391276.082522:0:8822:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52849ba680 x1877361186333696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391276.082551:0:8822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790391276.082610:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391276.082614:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391276.082616:0:8822:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790391276.082619:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391276.082623:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391276.082625:0:8822:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790391276.082628:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790391276.082630:0:8822:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790391276.082653:0:8822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8822:1877361186334208:0@lo:502: 00000100:00100000:3.0:1790391276.082680:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186333824:0@lo:400: 00000100:00100000:1.0:1790391276.082732:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186333696:0@lo:8: 00000100:00100000:3.0:1790391276.083272:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.083329:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186334464:0@lo:400: 00000100:00100000:3.0:1790391276.083357:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.083384:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391276.083390:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186334336:0@lo:400: 00000100:00100000:3.0:1790391276.083414:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.083448:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186333952:0@lo:400: 00000100:00100000:3.0:1790391276.083484:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.083508:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186334592:0@lo:400: 00000100:00100000:3.0:1790391276.083530:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.083547:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391276.083552:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186334080:0@lo:400: 00000100:00100000:3.0:1790391276.083571:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.083987:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186333824 00000100:00100000:3.0:1790391276.083996:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186333824 00000100:00100000:3.0:1790391276.084033:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186334464 00000100:00100000:3.0:1790391276.084036:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186334464 00000100:00100000:3.0:1790391276.084073:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186334592 00000100:00100000:3.0:1790391276.084076:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186334592 00000100:00100000:3.0:1790391276.084097:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186334080 00000100:00100000:3.0:1790391276.084100:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186334080 00000100:00100000:3.0:1790391276.084112:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391276.084119:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186333824:12345-0@lo:400: 00000100:00100000:3.0:1790391276.084178:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186333824:12345-0@lo:400: Request processed in 59us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.084185:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391276.084199:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391276.084205:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186334464:12345-0@lo:400: 00000100:00100000:3.0:1790391276.084244:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186334464:12345-0@lo:400: Request processed in 28us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.084251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391276.084261:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391276.084267:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186334592:12345-0@lo:400: 00000100:00100000:3.0:1790391276.084308:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186334592:12345-0@lo:400: Request processed in 41us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.084315:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391276.084325:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790391276.084330:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186334080:12345-0@lo:400: 00000100:00100000:3.0:1790391276.084356:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186334080:12345-0@lo:400: Request processed in 26us (784us total) trans 0 rc 0/0 00000100:00080000:2.0:1790391276.084358:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391276.084361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1790391276.084363:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391276.084380:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186334336 00000100:00100000:3.0:1790391276.084551:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186334336 00000100:00100000:3.0:1790391276.084583:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186333952 00000100:00100000:3.0:1790391276.084586:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186333952 00000100:00100000:3.0:1790391276.084692:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790391276.084701:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186334336:12345-0@lo:400: 00000100:00100000:3.0:1790391276.084818:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186334336:12345-0@lo:400: Request processed in 119us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.084825:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790391276.084838:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391276.084843:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186333952:12345-0@lo:400: 00000100:00100000:3.0:1790391276.084868:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186333952:12345-0@lo:400: Request processed in 25us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.084873:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391276.084937:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186334336:0@lo:400: 00010000:00080000:3.0:1790391276.084952:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206c700 x1877361186333824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391276.084964:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186333824:0@lo:400: 00010000:00080000:3.0:1790391276.084976:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206d880 x1877361186334464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391276.084985:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186334464:0@lo:400: 00010000:00080000:3.0:1790391276.085252:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206e680 x1877361186334080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391276.085262:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186334080:0@lo:400: 00000100:00100000:3.0:1790391276.085273:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186333952:0@lo:400: 00010000:00080000:3.0:1790391276.085292:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206f100 x1877361186334592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391276.085301:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186334592:0@lo:400: 00000100:00100000:0.0:1790391276.089744:0:8822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.089804:0:8822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5287d89180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391276.089913:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391276.089951:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186333696 00000100:00100000:1.0:1790391276.089966:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186333696 00000100:00100000:1.0:1790391276.089999:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391276.090007:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186333696:12345-0@lo:8: 00010000:00080000:1.0:1790391276.090039:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1790391276.090071:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e0d8f 00002000:00100000:1.0:1790391276.090105:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e52baf8e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1790391276.090110:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1790391276.090113:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1790391276.090250:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790391276.090764:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1790391276.090792:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9e52baf88800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391276.090849:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1877361186333696:12345-0@lo:8: Request processed in 840us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391276.090857:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790391276.090923:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52849ba680 x1877361186333696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391276.090934:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391276.090943:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1790391276.090950:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790391276.090956:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790391276.090958:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5fb1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790391276.090970:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790391276.090975:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186333696:0@lo:8: 00000004:00080000:0.0:1790391276.091081:0:8823:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790391276.091135:0:8823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 189458256975ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790391276.091141:0:8823:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1790391276.092084:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186334208 00000100:00100000:2.0:1790391276.092094:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186334208 00000100:00100000:2.0:1790391276.092137:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790391276.092146:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:8822:x1877361186334208:12345-0@lo:502: 00000100:00100000:2.0:1790391276.092305:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:8822:x1877361186334208:12345-0@lo:502: Request processed in 159us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391276.092313:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790391276.092564:0:8822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8822:1877361186334208:0@lo:502: 00000020:01000000:3.0:1790391276.092620:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391276.092626:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391276.092629:0:8822:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790391276.092633:0:8822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:2.0:1790391276.092650:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1877361186334720:0@lo:700: 00000100:00100000:2.0:1790391276.092685:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.092714:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186334720 00000100:00100000:2.0:1790391276.092718:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186334720 00000100:00100000:2.0:1790391276.092754:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1790391276.092759:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 00000100:00100000:2.0:1790391276.092761:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8824:x1877361186334720:12345-0@lo:700: 00000100:00100000:2.0:1790391276.092789:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1877361186334848:0@lo:700: 10000000:01000000:3.0:1790391276.092803:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790391276.092813:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391276.092817:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391276.092824:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391276.092835:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 00000100:00100000:2.0:1790391276.092835:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93cb40 going to sleep for 11 seconds 10000000:01000000:3.0:1790391276.092837:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5289da8000 from 30 10000000:01000000:3.0:1790391276.092840:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00080000:2.0:1790391276.092851:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391276.092857:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93ce40 going to sleep for 11 seconds 00010000:00010000:3.0:1790391276.092862:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.092870:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.092898:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391276.092910:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186334976:0@lo:101: 00000100:00100000:3.0:1790391276.092938:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.092964:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1840 going to sleep for 11 seconds 00000100:00100000:2.0:1790391276.093135:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186334976 00000100:00100000:2.0:1790391276.093140:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186334976 00000100:00100000:2.0:1790391276.093241:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790391276.093249:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186334976:12345-0@lo:101: 00010000:00010000:2.0:1790391276.093258:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391276.093270:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0d9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0d96 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391276.093292:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d96 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391276.093304:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d96 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391276.093314:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e529566ca00, rc 0) 00000100:00100000:2.0:1790391276.093551:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186334976:12345-0@lo:101: Request processed in 303us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391276.093558:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790391276.093724:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186334976:0@lo:101: 00010000:00010000:3.0:1790391276.093738:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.093755:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391276.093810:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186335104:0@lo:501: 00000100:00100000:3.0:1790391276.093834:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.093856:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.093866:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186335104 00000100:00100000:3.0:1790391276.093869:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186335104 00000100:00100000:3.0:1790391276.093907:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790391276.093914:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186335104:12345-0@lo:501: 00000100:00100000:3.0:1790391276.094015:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186335104:12345-0@lo:501: Request processed in 101us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.094021:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790391276.094052:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186335104:0@lo:501: 00000100:00100000:3.0:1790391276.094075:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186335232:0@lo:503: 00000100:00100000:3.0:1790391276.094112:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.094125:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.094134:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186335232 00000100:00100000:3.0:1790391276.094137:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186335232 00000100:00100000:3.0:1790391276.094157:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790391276.094162:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186335232:12345-0@lo:503: 00000100:00100000:3.0:1790391276.094230:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186335232:12345-0@lo:503: Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.094250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790391276.094483:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186335232:0@lo:503: 00000100:00100000:1.0:1790391276.094690:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186334848 00000100:00100000:1.0:1790391276.094696:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186334848 00000100:00100000:1.0:1790391276.094727:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391276.094734:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1877361186334848:12345-0@lo:700: 00000100:00100000:3.0:1790391276.094846:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8825:1877361186335360:0@lo:502: 00000100:00100000:3.0:1790391276.094927:0:8825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.094948:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186335360 00000100:00100000:3.0:1790391276.094951:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186335360 00000100:00100000:3.0:1790391276.094973:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790391276.094980:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:8825:x1877361186335360:12345-0@lo:502: 00000100:00100000:3.0:1790391276.095053:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:8825:x1877361186335360:12345-0@lo:502: Request processed in 73us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.095059:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790391276.095092:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1300 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.095105:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8825:1877361186335360:0@lo:502: 00000100:00100000:3.0:1790391276.095144:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8825:1877361186335488:0@lo:502: 00000100:00100000:3.0:1790391276.095174:0:8825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.095197:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391276.095968:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186335488 00000100:00100000:1.0:1790391276.095976:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186335488 00000100:00100000:1.0:1790391276.096013:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790391276.096021:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:8825:x1877361186335488:12345-0@lo:502: 00000100:00100000:1.0:1790391276.096136:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:8825:x1877361186335488:12345-0@lo:502: Request processed in 116us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391276.096143:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790391276.096170:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8825:1877361186335488:0@lo:502: 00000040:00080000:3.0:1790391276.096192:0:8825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790391276.096848:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790391276.096870:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790391276.096903:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391276.096915:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391276.096926:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790391276.096929:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5289da8000 from 5 10000000:01000000:1.0:1790391276.096932:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790391276.096964:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391276.096973:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391276.096983:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391276.097001:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186335616:0@lo:101: 00000100:00100000:1.0:1790391276.097040:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391276.097094:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb4540 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.097111:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186335616 00000100:00100000:3.0:1790391276.097116:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186335616 00000100:00100000:3.0:1790391276.097147:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790391276.097154:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186335616:12345-0@lo:101: 00010000:00010000:3.0:1790391276.097163:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391276.097176:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0dab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0da4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.097198:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0da4 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.097220:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0da4 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.097230:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144200, rc 0) 00000100:00100000:3.0:1790391276.097276:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186335616:12345-0@lo:101: Request processed in 123us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.097292:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790391276.098798:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186335616:0@lo:101: 00010000:00010000:1.0:1790391276.098821:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391276.098832:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391276.098909:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186335744:0@lo:256: 00000100:00100000:1.0:1790391276.098962:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391276.098990:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb4540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391276.099010:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186335744 00000100:00100000:1.0:1790391276.099015:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186335744 00000100:00100000:1.0:1790391276.099064:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790391276.099078:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186335744:12345-0@lo:256: 20000000:01000000:1.0:1790391276.099094:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790391276.099110:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790391276.099113:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1790391276.099210:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186335744:12345-0@lo:256: Request processed in 138us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391276.099218:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790391276.099230:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186335744:0@lo:256: 10000000:01000000:3.0:1790391276.099400:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391276.099407:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.099416:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391276.099423:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790391276.099426:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1790391276.099428:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790391276.099452:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.099458:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.099478:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391276.099490:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186335872:0@lo:101: 00000100:00100000:3.0:1790391276.099522:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.099536:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391276.101001:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186335872 00000100:00100000:2.0:1790391276.101015:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186335872 00000100:00100000:3.0:1790391276.101295:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790391276.101305:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186335872:12345-0@lo:101: 00010000:00010000:3.0:1790391276.101322:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391276.101340:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0db9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.101366:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0db2 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.101377:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0db2 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.101386:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144c00, rc 0) 00000100:00100000:3.0:1790391276.101444:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186335872:12345-0@lo:101: Request processed in 141us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.101450:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790391276.101503:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186335872:0@lo:101: 00010000:00010000:3.0:1790391276.101519:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391276.101529:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391276.101619:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186336000:0@lo:501: 00000100:00100000:3.0:1790391276.101671:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.101703:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.101742:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186336000 00000100:00100000:3.0:1790391276.101753:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186336000 00000100:00100000:3.0:1790391276.101782:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790391276.101791:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186336000:12345-0@lo:501: 00000004:00080000:1.0:1790391276.101847:0:7444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1790391276.101954:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186336000:12345-0@lo:501: Request processed in 165us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.101961:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790391276.102186:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186336000:0@lo:501: 00000100:00100000:1.0:1790391276.102217:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186336128:0@lo:503: 00000100:00100000:1.0:1790391276.102257:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391276.102278:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391276.102290:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186336128 00000100:00100000:1.0:1790391276.102293:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186336128 00000100:00100000:1.0:1790391276.102648:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790391276.102658:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186336128:12345-0@lo:503: 00000100:00100000:1.0:1790391276.102745:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186336128:12345-0@lo:503: Request processed in 88us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391276.102751:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790391276.102796:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186336128:0@lo:503: 00000100:00100000:2.0:1790391276.106117:0:8826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8826:1877361186336256:0@lo:502: 00000100:00100000:2.0:1790391276.106220:0:8826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.106265:0:8826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.126053:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186336256 00000100:00100000:3.0:1790391276.126068:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186336256 00000100:00100000:3.0:1790391276.126133:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790391276.126144:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:8826:x1877361186336256:12345-0@lo:502: 00000100:00100000:2.0:1790391276.126782:0:8826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8826:1877361186336256:0@lo:502: 00000020:01000000:2.0:1790391276.126822:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790391276.126829:0:8826:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790391276.126835:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391276.126843:0:8826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790391276.126847:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790391276.126851:0:8826:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000100:00100000:3.0:1790391276.127435:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:8826:x1877361186336256:12345-0@lo:502: Request processed in 1291us (21213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.127445:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 40000000:02000000:3.0:1790391276.127551:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:01000000:2.0:1790391276.129506:0:8826:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790391276.129517:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391276.129537:0:8826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e52b9d74d40) 00000020:00000080:2.0:1790391276.129563:0:8826:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1790391276.129570:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790391276.131593:0:8826:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790391276.131615:0:8826:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790391276.131626:0:8826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e0dc7 00010000:00080000:2.0:1790391276.131663:0:8826:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52b9a88800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391276.134316:0:8826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1790391276.143808:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1877361186334848:12345-0@lo:700: Request processed in 49066us (50981us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.143828:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790391276.144507:0:8435:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5181cbad80 x1877361186334848/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790391292 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391276.144525:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1877361186334848:0@lo:700: 40000000:02000000:2.0:1790391276.144543:0:8435:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:2.0:1790391276.166227:0:8826:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790391276.166254:0:8826:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790391276.167099:0:8826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391276.167326:0:8826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391276.167416:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1790391276.167532:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790391276.168734:0:8831:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790391276.168741:0:8831:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790391276.171334:0:8826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790391276.171351:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790391276.171770:0:8826:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790391276.171796:0:8826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e0dce 00000100:00080000:2.0:1790391276.171807:0:8826:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391276.171820:0:8826:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e52b9a88800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391276.171859:0:8826:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5181cbad80 x1877361186336384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391276.171905:0:8826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790391276.171992:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391276.171997:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391276.171999:0:8826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790391276.172002:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391276.172006:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391276.172007:0:8826:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790391276.172010:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391276.172012:0:8826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790391276.172044:0:8826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8826:1877361186336512:0@lo:502: 00000100:00100000:2.0:1790391276.172129:0:8826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.172191:0:8826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391276.172575:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186336384:0@lo:8: 00000100:00100000:1.0:1790391276.173573:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.173696:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186336384 00000100:00100000:0.0:1790391276.173712:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186336384 00000100:00100000:3.0:1790391276.173828:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186336512 00000100:00100000:3.0:1790391276.173833:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186336512 00000100:00100000:3.0:1790391276.173874:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790391276.173899:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:8826:x1877361186336512:12345-0@lo:502: 00000100:00100000:3.0:1790391276.174621:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:8826:x1877361186336512:12345-0@lo:502: Request processed in 723us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.174629:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790391276.174872:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391276.174893:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1877361186336384:12345-0@lo:8: 00010000:00080000:0.0:1790391276.174921:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000100:00100000:2.0:1790391276.174997:0:8826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:8826:1877361186336512:0@lo:502: 00000020:01000000:2.0:1790391276.175034:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391276.175043:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391276.175045:0:8826:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790391276.175050:0:8826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:00000080:0.0:1790391276.175687:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e0dd5 00002000:00100000:0.0:1790391276.175704:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e52b5fb3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790391276.175709:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1790391276.175712:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790391276.176271:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790391276.176301:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e52b5fb5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391276.176389:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1877361186336384:12345-0@lo:8: Request processed in 1495us (2818us total) trans 0 rc 0/0 00010000:00080000:3.0:1790391276.176949:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5181cbad80 x1877361186336384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391276.176978:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391276.176988:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790391276.176997:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790391276.177003:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790391276.177005:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b9a88800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790391276.177022:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790391276.177028:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186336384:0@lo:8: 00000100:00100000:0.0:1790391276.177552:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:1.0:1790391276.178616:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1790391276.178655:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790391276.178667:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391276.178680:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391276.178691:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790391276.178694:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e52ae8c99c0 from 1 10000000:01000000:1.0:1790391276.178697:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790391276.178896:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391276.178907:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391276.178917:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391276.178940:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186336640:0@lo:101: 00000100:00100000:1.0:1790391276.179025:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391276.179060:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae97c840 going to sleep for 11 seconds 00000100:00100000:1.0:1790391276.179079:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186336640 00000100:00100000:1.0:1790391276.179085:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186336640 00000100:00100000:1.0:1790391276.179127:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790391276.179136:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186336640:12345-0@lo:101: 00010000:00010000:1.0:1790391276.179149:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391276.179161:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0ddc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391276.180166:0:8831:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790391276.180935:0:8831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 189548056510ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790391276.180948:0:8831:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1790391276.181025:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ddc expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391276.181050:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ddc expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391276.181060:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f6600, rc 0) 00000100:00100000:1.0:1790391276.181146:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186336640:12345-0@lo:101: Request processed in 2009us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391276.181156:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790391276.181940:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186336640:0@lo:101: 00010000:00010000:2.0:1790391276.181965:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391276.181976:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391276.182067:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186336768:0@lo:501: 00000100:00100000:2.0:1790391276.182112:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.182159:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.182332:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186336768 00000100:00100000:3.0:1790391276.182338:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186336768 00000100:00100000:3.0:1790391276.182382:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790391276.182391:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186336768:12345-0@lo:501: 00000100:00100000:3.0:1790391276.182497:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186336768:12345-0@lo:501: Request processed in 106us (386us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790391276.182505:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790391276.183328:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186336896:0@lo:13: 00000100:00100000:2.0:1790391276.183559:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186336768:0@lo:501: 10000000:01000000:2.0:1790391276.183604:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790391276.183613:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391276.183623:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391276.183693:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1790391276.183813:0:8832:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1790391276.183838:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8832:1877361186337024:0@lo:7: 00000100:00100000:0.0:1790391276.183869:0:8832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.183920:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186337024 00000100:00100000:0.0:1790391276.183926:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186337024 00000001:00100000:3.0:1790391276.184079:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1790391276.184146:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8824:x1877361186334720:12345-0@lo:700: Request processed in 91384us (91459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391276.184160:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391276.184203:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391276.184213:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8832:x1877361186337024:12345-0@lo:7: 00000100:00080000:3.0:1790391276.184979:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391276.184992:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5287d89180 going to sleep for 11 seconds 00000004:00080000:3.0:1790391276.185266:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1790391276.187298:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186336896 00000100:00100000:2.0:1790391276.187311:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186336896 00000100:00100000:2.0:1790391276.187612:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391276.187624:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186336896:12345-0@lo:13: 00002000:00000024:2.0:1790391276.187656:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923898368 avail 3692376064 00000100:00100000:2.0:1790391276.187742:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186336896:12345-0@lo:13: Request processed in 121us (4049us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391276.187750:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790391276.187799:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5181cba300 x1877361186334720/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790391292 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391276.187815:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1877361186334720:0@lo:700: 00010000:00080000:3.0:1790391276.187988:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52849b9c00 x1877361186336896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391276.188005:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186336896:0@lo:13: 00002000:00080000:0.0:1790391276.191044:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1790391276.191054:0:8428:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790391276.191159:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8832:x1877361186337024:12345-0@lo:7: Request processed in 6943us (7284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.191170:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790391276.191543:0:8832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52849bbb80 x1877361186337024/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790391292 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391276.191573:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8832:1877361186337024:0@lo:7: 00000004:00080000:3.0:1790391276.191589:0:8832:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790391276.191650:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8832:1877361186337152:0@lo:5: 00000100:00100000:3.0:1790391276.191692:0:8832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.191730:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5182200600 going to sleep for 11 seconds 00000100:00100000:1.0:1790391276.192093:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186337152 00000100:00100000:1.0:1790391276.192102:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186337152 00000100:00100000:1.0:1790391276.192153:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391276.192162:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8832:x1877361186337152:12345-0@lo:5: 00002000:00080000:1.0:1790391276.192188:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1790391276.192192:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1790391276.202126:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1790391276.202146:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790391276.202292:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8832:x1877361186337152:12345-0@lo:5: Request processed in 10124us (10593us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790391276.202317:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790391276.202745:0:8832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206ed80 x1877361186337152/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391292 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391276.202759:0:8832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790391276.202766:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8832:1877361186337152:0@lo:5: 00000004:00080000:0.0:1790391276.202783:0:8832:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1790391276.202836:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8832:1877361186337280:0@lo:700: 00000004:00080000:2.0:1790391276.202899:0:8824:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1790391276.202900:0:8832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.202920:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1877361186337536:0@lo:7: 00000100:00100000:0.0:1790391276.202941:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391276.202956:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.202992:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391276.203005:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391276.203016:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186337408:0@lo:13: 00000100:00100000:2.0:1790391276.203040:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.203077:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186337408 00000100:00100000:2.0:1790391276.203084:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186337408 00000100:00100000:0.0:1790391276.203102:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186337536 00000100:00100000:0.0:1790391276.203109:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186337536 00000100:00100000:2.0:1790391276.203128:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391276.203138:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1877361186337408:12345-0@lo:13: 00000100:00100000:0.0:1790391276.203153:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00002000:00000024:2.0:1790391276.203159:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923898368 avail 3692376064 00000100:00100000:0.0:1790391276.203165:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8824:x1877361186337536:12345-0@lo:7: 00000100:00100000:2.0:1790391276.203201:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1877361186337408:12345-0@lo:13: Request processed in 64us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391276.203209:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790391276.203240:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5181cba300 x1877361186337408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391276.203257:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186337408:0@lo:13: 00000100:00100000:1.0:1790391276.203369:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186337280 00000100:00100000:1.0:1790391276.203375:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186337280 00000100:00100000:1.0:1790391276.203415:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391276.203432:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8832:x1877361186337280:12345-0@lo:700: 00002000:00080000:0.0:1790391276.211822:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1790391276.211832:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1790391276.212116:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8824:x1877361186337536:12345-0@lo:7: Request processed in 8950us (9156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391276.212129:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790391276.212157:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5181cb9f80 x1877361186337536/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790391292 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391276.212175:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1877361186337536:0@lo:7: 00000004:00080000:2.0:1790391276.212189:0:8824:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1790391276.212233:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1877361186337664:0@lo:5: 00000100:00100000:2.0:1790391276.212608:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391276.212682:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.216967:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186337664 00000100:00100000:3.0:1790391276.216983:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186337664 00000100:00100000:2.0:1790391276.217734:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391276.217746:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8824:x1877361186337664:12345-0@lo:5: 00002000:00080000:2.0:1790391276.217781:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1790391276.217908:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8824:x1877361186337664:12345-0@lo:5: Request processed in 164us (5300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391276.217916:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790391276.218033:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5181cb9f80 x1877361186337664/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391292 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391276.218052:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1877361186337664:0@lo:5: 00000004:00080000:3.0:1790391276.218069:0:8824:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790391276.218122:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1877361186337792:0@lo:5: 00000100:00100000:3.0:1790391276.218164:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.218748:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5182200900 going to sleep for 11 seconds 00000100:00100000:1.0:1790391276.218831:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186337792 00000100:00100000:1.0:1790391276.218838:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186337792 00000100:00100000:1.0:1790391276.218872:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391276.218906:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8824:x1877361186337792:12345-0@lo:5: 00002000:00080000:1.0:1790391276.218937:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1790391276.222866:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8824:x1877361186337792:12345-0@lo:5: Request processed in 3954us (4693us total) trans 4294967298 rc 0/0 00010000:00080000:3.0:1790391276.222924:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206d880 x1877361186337792/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391292 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391276.222929:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391276.222950:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1877361186337792:0@lo:5: 00000004:00080000:3.0:1790391276.222968:0:8824:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1790391276.223014:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8824:1877361186337920:0@lo:900: 00000100:00100000:3.0:1790391276.223105:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391276.223134:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5182200900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391276.223158:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186337920 00000100:00100000:0.0:1790391276.223167:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186337920 00000100:00100000:0.0:1790391276.223210:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391276.223220:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8824:x1877361186337920:12345-0@lo:900: 00000100:00100000:1.0:1790391276.223485:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8832:x1877361186337280:12345-0@lo:700: Request processed in 20052us (20584us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391276.223494:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391276.223559:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8824:x1877361186337920:12345-0@lo:900: Request processed in 339us (451us total) trans 0 rc 0/0 00010000:00080000:3.0:1790391276.223561:0:8832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52849bbb80 x1877361186337280/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790391292 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391276.223576:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391276.223581:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8832:1877361186337280:0@lo:700: 00010000:00080000:2.0:1790391276.223594:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206df80 x1877361186337920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790391292 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391276.223830:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8824:1877361186337920:0@lo:900: 00000004:02000040:0.0:1790391276.226580:0:8832:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1790391276.233122:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8832:1877361186338048:0@lo:5: 00000100:00100000:0.0:1790391276.233193:0:8832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391276.233237:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391276.233348:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186338048 00000100:00100000:3.0:1790391276.233358:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186338048 00000100:00100000:3.0:1790391276.233430:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391276.233440:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8832:x1877361186338048:12345-0@lo:5: 00002000:00080000:3.0:1790391276.253187:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1790391276.253203:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1790391276.261850:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8832:x1877361186338048:12345-0@lo:5: Request processed in 28402us (28648us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790391276.261866:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790391276.262809:0:8832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52849bb480 x1877361186338048/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391292 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391276.262830:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8832:1877361186338048:0@lo:5: 00000004:00080000:0.0:1790391276.262845:0:8832:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:2.0:1790391276.415622:0:8854:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391276.417245:0:8854:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790391276.488068:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391276.553830:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186338176:0@lo:41: 00000100:00100000:1.0:1790391276.553922:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391276.553996:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186338176 00000100:00100000:1.0:1790391276.554003:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186338176 00000100:00100000:1.0:1790391276.554062:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391276.554072:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186338176:12345-0@lo:41: 00000004:00000024:1.0:1790391276.554105:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1790391276.554152:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186338176:12345-0@lo:41: Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391276.554159:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391276.554222:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186338176:0@lo:41: 00000001:00080000:2.0:1790391277.240567:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1790391277.240586:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1790391277.512241:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391278.536228:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391278.601562:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186338304:0@lo:41: 00000100:00100000:3.0:1790391278.601634:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391278.601761:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186338304 00000100:00100000:2.0:1790391278.601780:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186338304 00000100:00100000:2.0:1790391278.601839:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790391278.601850:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186338304:12345-0@lo:41: 00000004:00000024:2.0:1790391278.601904:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1790391278.601954:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186338304:12345-0@lo:41: Request processed in 106us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391278.601962:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391278.602120:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186338304:0@lo:41: 00000020:00000004:3.0:1790391279.044825:0:8956:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391279.045356:0:8956:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790391279.560497:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790391280.023499:0:9004:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391280.023510:0:9004:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1790391280.584299:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391281.613151:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391281.672251:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186338432:0@lo:41: 00000100:00100000:3.0:1790391281.672390:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391281.672832:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186338432 00000100:00100000:1.0:1790391281.672843:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186338432 00000100:00100000:1.0:1790391281.672936:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391281.672946:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186338432:12345-0@lo:41: 00000004:00000024:1.0:1790391281.672984:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1790391281.673242:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186338432:12345-0@lo:41: Request processed in 297us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391281.673264:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391281.673393:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186338432:0@lo:41: 00000100:00100000:3.0:1790391281.673525:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186338560:0@lo:400: 00000100:00100000:3.0:1790391281.673559:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.673582:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186339072:0@lo:400: 00000100:00100000:3.0:1790391281.673609:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.673630:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790391281.673636:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186338688:0@lo:400: 00000100:00100000:3.0:1790391281.673657:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.673673:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186339200:0@lo:400: 00000100:00100000:3.0:1790391281.673703:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.673733:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186339072 00000100:00100000:3.0:1790391281.673737:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186339072 00000100:00100000:3.0:1790391281.673769:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186338688 00000100:00100000:3.0:1790391281.673772:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186338688 00000100:00100000:3.0:1790391281.673783:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186339200 00000100:00100000:3.0:1790391281.673786:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186339200 00000100:00100000:3.0:1790391281.673803:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790391281.673809:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186339072:12345-0@lo:400: 00000100:00100000:3.0:1790391281.673846:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186339072:12345-0@lo:400: Request processed in 37us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.673853:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790391281.673867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790391281.673957:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186338688:12345-0@lo:400: 00000100:00100000:3.0:1790391281.673990:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186338688:12345-0@lo:400: Request processed in 117us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.674114:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790391281.674130:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790391281.674137:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186339200:12345-0@lo:400: 00000100:00100000:3.0:1790391281.674168:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186339200:12345-0@lo:400: Request processed in 32us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.674173:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1790391281.674198:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391281.674202:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391281.674212:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186338816:0@lo:400: 00000100:00100000:3.0:1790391281.674238:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.674258:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186339328:0@lo:400: 00000100:00100000:3.0:1790391281.674290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.674338:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790391281.674345:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186338944:0@lo:400: 00000100:00100000:3.0:1790391281.674368:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.674384:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186339456:0@lo:400: 00000100:00100000:3.0:1790391281.674405:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391281.674441:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186338816 00000100:00100000:3.0:1790391281.674445:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186338816 00000100:00100000:3.0:1790391281.674471:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391281.674477:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186338816:12345-0@lo:400: 00000100:00100000:3.0:1790391281.674514:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186338816:12345-0@lo:400: Request processed in 37us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.674520:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391281.674536:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186339328 00000100:00100000:3.0:1790391281.674539:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186339328 00000100:00100000:3.0:1790391281.674581:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186339456 00000100:00100000:3.0:1790391281.674585:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186339456 00000100:00100000:3.0:1790391281.674600:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391281.674606:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186339328:12345-0@lo:400: 00000100:00100000:3.0:1790391281.674637:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186339328:12345-0@lo:400: Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.674643:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391281.674655:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391281.674661:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186339456:12345-0@lo:400: 00000100:00100000:3.0:1790391281.674688:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186339456:12345-0@lo:400: Request processed in 28us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391281.674694:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790391281.674722:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790391281.674743:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206f100 x1877361186338688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391281.674755:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186338688:0@lo:400: 00010000:00080000:3.0:1790391281.674765:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf949180 x1877361186339200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391281.674773:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186339200:0@lo:400: 00010000:00080000:3.0:1790391281.674782:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf94bb80 x1877361186339072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391281.674789:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186339072:0@lo:400: 00010000:00080000:3.0:1790391281.674818:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf948e00 x1877361186339456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391281.674825:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1790391281.674834:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186339456:0@lo:400: 00000100:00100000:3.0:1790391281.674845:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186338816:0@lo:400: 00010000:00080000:3.0:1790391281.674854:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf94aa00 x1877361186339328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391281.674860:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790391281.674870:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186339328:0@lo:400: 00000100:00100000:2.0:1790391281.675091:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186338944 00000100:00100000:2.0:1790391281.675095:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186338944 00000100:00100000:2.0:1790391281.675120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790391281.675126:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186338944:12345-0@lo:400: 00000100:00100000:2.0:1790391281.675158:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186338944:12345-0@lo:400: Request processed in 33us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391281.675164:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790391281.675193:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391281.675202:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186339584:0@lo:13: 00000100:00100000:2.0:1790391281.675229:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391281.675256:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186339584 00000100:00100000:2.0:1790391281.675260:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186339584 00000100:00100000:2.0:1790391281.675284:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391281.675290:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186339584:12345-0@lo:13: 00002000:00000024:2.0:1790391281.675310:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391281.675345:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186339584:12345-0@lo:13: Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391281.675351:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790391281.675378:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5181cb8380 x1877361186339584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391281.675390:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186339584:0@lo:13: 00000100:00100000:1.0:1790391281.676619:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186338560 00000100:00100000:1.0:1790391281.676629:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186338560 00000100:00100000:1.0:1790391281.676670:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790391281.676678:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:3639:x1877361186338560:12345-0@lo:400: 00000100:00100000:1.0:1790391281.676729:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:3639:x1877361186338560:12345-0@lo:400: Request processed in 53us (3170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391281.676736:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790391281.676780:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186338560:0@lo:400: 00000100:00100000:1.0:1790391281.676795:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391281.676802:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186339712:0@lo:13: 00000100:00100000:1.0:1790391281.676829:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391281.676860:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186339712 00000100:00100000:1.0:1790391281.676863:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186339712 00000100:00100000:1.0:1790391281.676923:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391281.676930:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186339712:12345-0@lo:13: 00002000:00000024:1.0:1790391281.676945:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391281.676979:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186339712:12345-0@lo:13: Request processed in 49us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391281.676984:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790391281.677194:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518229f100 x1877361186339712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391281.677210:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186339712:0@lo:13: 00010000:00080000:3.0:1790391281.678324:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf94b800 x1877361186338944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391281.678338:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186338944:0@lo:400: 00010000:00010000:2.0:1790391282.633130:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391283.657992:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391283.736872:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391283.736917:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186339840:0@lo:41: 00000100:00100000:1.0:1790391283.737014:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391283.737088:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186339840 00000100:00100000:1.0:1790391283.737095:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186339840 00000100:00100000:1.0:1790391283.737146:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790391283.737155:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186339840:12345-0@lo:41: 00000004:00000024:1.0:1790391283.737189:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1790391283.737237:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186339840:12345-0@lo:41: Request processed in 82us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391283.737244:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790391283.737303:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186339840:0@lo:41: 00010000:00010000:3.0:1790391284.681023:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391285.704358:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391286.728159:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391286.793692:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186339968:0@lo:41: 00000100:00100000:2.0:1790391286.793768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391286.793829:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391286.793837:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186340096:0@lo:13: 00000100:00100000:2.0:1790391286.793863:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391286.793927:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186339968 00000100:00100000:2.0:1790391286.793934:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186339968 00000100:00100000:2.0:1790391286.793983:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790391286.793991:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186339968:12345-0@lo:41: 00000004:00000024:2.0:1790391286.794024:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1790391286.794067:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186339968:12345-0@lo:41: Request processed in 76us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391286.794074:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790391286.794096:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186340096 00000100:00100000:2.0:1790391286.794100:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186340096 00000100:00100000:2.0:1790391286.794136:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391286.794144:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186340096:12345-0@lo:13: 00002000:00000024:2.0:1790391286.794162:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391286.794196:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186340096:12345-0@lo:13: Request processed in 53us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391286.794203:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790391286.794223:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790391286.794252:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5181cbad80 x1877361186340096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391286.794270:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186340096:0@lo:13: 00000100:00100000:2.0:1790391286.794303:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186339968:0@lo:41: 00000100:00100000:3.0:1790391286.797310:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186340224:0@lo:13: 00000100:00100000:3.0:1790391286.797388:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391286.797643:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186340224 00000100:00100000:2.0:1790391286.797651:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186340224 00000100:00100000:2.0:1790391286.797707:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391286.797716:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186340224:12345-0@lo:13: 00002000:00000024:2.0:1790391286.797737:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391286.797778:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186340224:12345-0@lo:13: Request processed in 63us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391286.797797:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790391286.797820:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790391286.797907:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5181cb8380 x1877361186340224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391286.797926:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186340224:0@lo:13: 00000100:00100000:0.0:1790391286.803552:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186340352:0@lo:400: 00000100:00100000:0.0:1790391286.803625:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391286.803703:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186340480:0@lo:400: 00000100:00100000:0.0:1790391286.803733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391286.803775:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186340480 00000100:00100000:0.0:1790391286.803782:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186340480 00000100:00100000:0.0:1790391286.803827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790391286.803837:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186340480:12345-0@lo:400: 00000100:00100000:0.0:1790391286.803912:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186340480:12345-0@lo:400: Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391286.803920:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1790391286.803962:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52849bbb80 x1877361186340480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391286.803976:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186340480:0@lo:400: 00000100:00100000:0.0:1790391286.804022:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391286.804030:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186340608:0@lo:400: 00000100:00100000:0.0:1790391286.804067:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391286.804109:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186340736:0@lo:400: 00000100:00100000:0.0:1790391286.804131:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391286.804160:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186340736 00000100:00100000:0.0:1790391286.804164:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186340736 00000100:00100000:0.0:1790391286.804184:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391286.804189:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186340736:12345-0@lo:400: 00000100:00100000:0.0:1790391286.804222:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186340736:12345-0@lo:400: Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391286.804228:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1790391286.804251:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52b5d04000 x1877361186340736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391286.804261:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186340736:0@lo:400: 00000100:00100000:0.0:1790391286.804291:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186340864:0@lo:400: 00000100:00100000:0.0:1790391286.804312:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391286.804339:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186340864 00000100:00100000:0.0:1790391286.804343:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186340864 00000100:00100000:0.0:1790391286.804387:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391286.804395:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186340864:12345-0@lo:400: 00000100:00100000:0.0:1790391286.804445:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186340864:12345-0@lo:400: Request processed in 43us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391286.804451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1790391286.804467:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790391286.804484:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52b5d04000 x1877361186340864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391286.804501:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186340864:0@lo:400: 00000100:00100000:0.0:1790391286.804555:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186340992:0@lo:400: 00000100:00100000:0.0:1790391286.804600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391286.804638:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186340992 00000100:00100000:0.0:1790391286.804650:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186340992 00000100:00100000:0.0:1790391286.804682:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391286.804689:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186340992:12345-0@lo:400: 00000100:00100000:0.0:1790391286.804730:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186340992:12345-0@lo:400: Request processed in 41us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391286.804736:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1790391286.804758:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790391286.804775:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52b5d04000 x1877361186340992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391286.804792:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186340992:0@lo:400: 00000100:00100000:0.0:1790391286.804852:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186340352 00000100:00100000:0.0:1790391286.804857:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186340352 00000100:00100000:0.0:1790391286.804910:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790391286.804918:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:3637:x1877361186340352:12345-0@lo:400: 00000100:00100000:0.0:1790391286.804959:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:3637:x1877361186340352:12345-0@lo:400: Request processed in 35us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391286.804964:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790391286.805005:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186340352:0@lo:400: 00000100:00100000:0.0:1790391286.805038:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186340608 00000100:00100000:0.0:1790391286.805042:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186340608 00000100:00100000:0.0:1790391286.805075:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790391286.805081:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186340608:12345-0@lo:400: 00000100:00100000:0.0:1790391286.805120:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186340608:12345-0@lo:400: Request processed in 40us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391286.805140:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790391286.805173:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186340608:0@lo:400: 00010000:00010000:1.0:1790391287.752265:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391288.786031:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391288.843676:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186341120:0@lo:41: 00000100:00100000:0.0:1790391288.843752:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391288.844269:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186341120 00000100:00100000:1.0:1790391288.844279:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186341120 00000100:00100000:1.0:1790391288.844335:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790391288.844345:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186341120:12345-0@lo:41: 00000004:00000024:1.0:1790391288.844392:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1790391288.844450:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186341120:12345-0@lo:41: Request processed in 106us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391288.844457:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790391288.844504:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186341120:0@lo:41: 00010000:00010000:2.0:1790391289.804221:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790391289.941419:0:9503:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790391289.941423:0:9503:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790391289.941424:0:9503:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790391289.941555:0:9503:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e52bf9b4000 00000020:01000004:2.0:1790391289.941570:0:9503:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790391289.941583:0:9503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790391289.941596:0:9503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e52b9d719c0) 00000020:00000080:2.0:1790391289.941613:0:9503:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790391290.001451:0:9503:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790391290.001508:0:9503:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1790391290.034740:0:9503:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790391290.035169:0:9503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790391290.035700:0:9503:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790391290.035719:0:9503:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2b1b7949f13e0df1 00000020:01000004:3.0:1790391290.035728:0:9503:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1790391290.035751:0:9503:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.128@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790391290.035756:0:9503:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790391290.035762:0:9503:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790391290.035794:0:9503:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1790391290.035798:0:9503:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790391290.072607:0:9503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790391290.072769:0:9503:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.128@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1790391290.072773:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790391290.072775:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391290.072777:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391290.072778:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391290.072779:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391290.072780:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391290.072781:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391290.072783:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391290.072784:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391290.072785:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391290.072786:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391290.072790:0:9503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1790391290.072792:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391290.072794:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790391290.072795:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391290.072796:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391290.072797:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391290.072798:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391290.072799:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391290.072804:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790391290.072805:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790391290.072806:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391290.072806:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790391290.073024:0:9503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790391290.073045:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186341248:0@lo:253: 00000100:00100000:2.0:1790391290.073116:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391290.073213:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967adf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391290.073635:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186341248 00000100:00100000:0.0:1790391290.073644:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186341248 00000100:00100000:0.0:1790391290.073707:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790391290.073717:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:9503:x1877361186341248:12345-0@lo:253: 20000000:01000000:0.0:1790391290.073748:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790391290.073753:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1790391290.073759:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1790391290.073762:0:6505:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1790391290.074211:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391290.074350:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1790391290.074369:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1790391290.074386:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1790391290.074393:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1790391290.074404:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1790391290.074420:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1790391290.074509:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1790391290.074525:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.128@tcp 20000000:01000000:0.0:1790391290.074527:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.128@tcp (null) (null) (null) 00000040:00080000:0.0:1790391290.074541:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1790391290.074546:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790391290.074561:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1790391290.074566:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.128@tcp (null) (null) 00000040:00080000:0.0:1790391290.074579:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1790391290.074586:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790391290.074610:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1790391290.075141:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1790391290.075287:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1790391290.075301:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.128@tcp 20000000:01000000:0.0:1790391290.075303:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.128@tcp (null) (null) (null) 00000040:00080000:0.0:1790391290.075316:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1790391290.075322:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790391290.075347:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1790391290.075353:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.128@tcp (null) (null) 00000040:00080000:0.0:1790391290.075366:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1790391290.075373:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790391290.075386:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1790391290.075416:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1790391290.076355:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1790391290.076374:0:6505:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.128@tcp 20000000:01000000:0.0:1790391290.076376:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.128@tcp (null) (null) (null) 00000040:00080000:0.0:1790391290.076391:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1790391290.076397:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790391290.076410:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1790391290.076416:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.128@tcp (null) (null) 00000040:00080000:0.0:1790391290.076430:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1790391290.076437:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790391290.076452:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1790391290.076469:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1790391290.076483:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790391290.076487:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790391290.076490:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790391290.076536:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790391290.076539:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790391290.077581:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1790391290.077633:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1790391290.077660:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1790391290.077965:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1790391290.077986:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1790391290.078001:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1790391290.078012:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790391290.078013:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790391290.078446:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1790391290.078577:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1790391290.078595:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1790391290.078608:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1790391290.078681:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790391290.078684:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790391290.080489:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1790391290.080540:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1790391290.080553:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1790391290.080913:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1790391290.081479:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1790391290.081496:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1790391290.081509:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790391290.081512:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790391290.082703:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1790391290.082736:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1790391290.082752:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1790391290.083303:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1790391290.083324:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1790391290.083347:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1790391290.084344:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1790391290.084347:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790391290.084829:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1790391290.085156:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1790391290.085242:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1790391290.085508:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1790391290.085532:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1790391290.085546:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1790391290.085561:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790391290.085580:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.085598:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ce7 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.085606:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d11 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.085692:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d50 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.085699:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d6c expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.085704:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d96 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.085712:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0db2 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.085718:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ddc expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.085726:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.085769:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0ddc expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.085784:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0de3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ddc expref: 21 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391290.085800:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186341376:0@lo:104: 00000100:00100000:2.0:1790391290.086126:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391290.086226:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0db2 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.086234:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0db9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0db2 expref: 21 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391290.086249:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186341504:0@lo:104: 00000100:00100000:2.0:1790391290.086274:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391290.086408:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0d96 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.086416:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0d9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d96 expref: 21 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391290.086425:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186341632:0@lo:104: 00000100:00100000:2.0:1790391290.086448:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.086513:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186341376 00000100:00100000:3.0:1790391290.086521:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186341376 00000100:00100000:3.0:1790391290.086559:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186341504 00000100:00100000:3.0:1790391290.086562:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186341504 00000100:00100000:3.0:1790391290.086577:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391290.086585:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6505:x1877361186341376:12345-0@lo:104: 00010000:00010000:3.0:1790391290.086598:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.086672:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790391290.086679:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6505:x1877361186341376:12345-0@lo:104: Request processed in 95us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.086686:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391290.086704:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391290.086710:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6505:x1877361186341504:12345-0@lo:104: 00010000:00010000:3.0:1790391290.086717:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.086752:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790391290.086757:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6505:x1877361186341504:12345-0@lo:104: Request processed in 48us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.086763:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1790391290.086781:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391290.086787:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.086794:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f7600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391290.086798:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.086820:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391290.086827:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391290.086833:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790391290.086910:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.086927:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391290.086946:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.086954:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7600/0x2b1b7949f13e0ddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0de3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.086967:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391290.086970:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.086976:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391290.086979:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.087006:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391290.087013:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391290.087024:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790391290.087045:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.087051:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391290.087064:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.087079:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.087089:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391290.087090:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391290.087092:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391290.087139:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186341760:0@lo:103: 00000100:00100000:3.0:1790391290.087405:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.087449:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391290.087457:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186341888:0@lo:103: 00000100:00100000:3.0:1790391290.087480:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.087510:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186341760 00000100:00100000:3.0:1790391290.087515:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186341760 00010000:00010000:3.0:1790391290.087534:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0de3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ddc expref: 22 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391290.087555:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186341888 00000100:00100000:3.0:1790391290.087559:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186341888 00010000:00010000:3.0:1790391290.087585:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0db9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0db2 expref: 23 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391290.087671:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391290.087682:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:3640:x1877361186341760:12345-0@lo:103: 00010000:00010000:3.0:1790391290.087694:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391290.087700:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0de3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ddc expref: 23 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.087710:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0de3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ddc expref: 23 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.087726:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391290.087755:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:3640:x1877361186341760:12345-0@lo:103: Request processed in 76us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.087761:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391290.087776:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391290.087782:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:3638:x1877361186341888:12345-0@lo:103: 00010000:00010000:3.0:1790391290.087798:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391290.087803:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0db9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0db2 expref: 22 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.087810:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0db9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0db2 expref: 22 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.087827:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391290.087861:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:3638:x1877361186341888:12345-0@lo:103: Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.087866:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391290.088395:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186341888:0@lo:103: 00000100:00100000:3.0:1790391290.088441:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186341760:0@lo:103: 00010000:00010000:0.0:1790391290.088562:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391290.088819:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0d6c expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.088831:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0d73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d6c expref: 21 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391290.088849:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186342016:0@lo:104: 00000100:00100000:2.0:1790391290.088894:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391290.088928:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0d50 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.088936:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0d57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d50 expref: 21 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391290.088951:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186342144:0@lo:104: 00000100:00100000:2.0:1790391290.088978:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391290.089014:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0d11 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.089036:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0d18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d11 expref: 21 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391290.089046:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186342272:0@lo:104: 00000100:00100000:2.0:1790391290.089070:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391290.089087:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0ce7 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.089095:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0cee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ce7 expref: 21 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391290.089103:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186342400:0@lo:104: 00000100:00100000:2.0:1790391290.089119:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7470780 going to sleep for 11 seconds 00010000:00010000:2.0:1790391290.089130:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0ddc expref: 21 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391290.089141:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186341376:0@lo:104: 00010000:00010000:2.0:1790391290.089159:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0db9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0db2 expref: 20 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391290.089168:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186341504:0@lo:104: 00000100:00100000:0.0:1790391290.089408:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790391290.089425:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391290.089441:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186341632 00000100:00100000:0.0:1790391290.089445:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186341632 00000100:00100000:0.0:1790391290.089467:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186342016 00000100:00100000:0.0:1790391290.089469:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186342016 00000100:00100000:0.0:1790391290.089476:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186342144 00000100:00100000:0.0:1790391290.089478:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186342144 00000100:00100000:0.0:1790391290.089485:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186342272 00000100:00100000:0.0:1790391290.089486:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186342272 00000100:00100000:0.0:1790391290.089493:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186342400 00000100:00100000:0.0:1790391290.089495:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186342400 00000100:00100000:0.0:1790391290.089507:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790391290.089513:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+7:6505:x1877361186341632:12345-0@lo:104: 00010000:00010000:0.0:1790391290.089524:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.089580:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790391290.089585:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+7:6505:x1877361186341632:12345-0@lo:104: Request processed in 73us (3137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.089592:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790391290.089607:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790391290.089613:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+6:6505:x1877361186342016:12345-0@lo:104: 00010000:00010000:0.0:1790391290.089632:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.089663:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790391290.089674:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+6:6505:x1877361186342016:12345-0@lo:104: Request processed in 62us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.089680:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790391290.089691:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391290.089696:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:6505:x1877361186342144:12345-0@lo:104: 00010000:00010000:0.0:1790391290.089704:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.089729:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790391290.089733:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:6505:x1877361186342144:12345-0@lo:104: Request processed in 37us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.089738:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391290.089748:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391290.089753:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bbf9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6505:x1877361186342272:12345-0@lo:104: 00010000:00010000:0.0:1790391290.089760:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.089797:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790391290.089802:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bbf9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6505:x1877361186342272:12345-0@lo:104: Request processed in 50us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.089809:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391290.089854:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391290.089861:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6505:x1877361186342400:12345-0@lo:104: 00010000:00010000:0.0:1790391290.089894:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090061:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1790391290.090072:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6505:x1877361186342400:12345-0@lo:104: Request processed in 212us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.090087:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1790391290.090106:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790391290.090111:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090119:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145200 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391290.090123:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090132:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391290.090139:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391290.090145:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391290.090258:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090265:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391290.090281:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090288:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0d96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090309:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790391290.090313:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090334:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391290.090353:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090360:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391290.090366:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391290.090370:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391290.090384:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090395:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391290.090406:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090413:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0d6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090429:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790391290.090432:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090438:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566da00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391290.090440:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090455:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391290.090462:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391290.090466:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391290.090480:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090485:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391290.090490:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090496:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e0d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d57 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090504:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391290.090507:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090512:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391290.090514:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090520:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391290.090525:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391290.090535:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391290.090548:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090555:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391290.090560:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090566:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295145000/0x2b1b7949f13e0d11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d18 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090584:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391290.090587:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090592:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566c600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391290.090595:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.090601:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391290.090606:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391290.090611:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1790391290.090810:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186341632:0@lo:104: 00000100:00100000:2.0:1790391290.090829:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186342016:0@lo:104: 00000100:00100000:2.0:1790391290.090848:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186342144:0@lo:104: 00000100:00100000:2.0:1790391290.090862:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186342272:0@lo:104: 00000100:00100000:2.0:1790391290.090869:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6505:1877361186342400:0@lo:104: 00010000:00010000:2.0:1790391290.091059:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.091134:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.091141:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391290.091152:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.091167:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566c600/0x2b1b7949f13e0ce7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0cee expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.091264:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391290.091266:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391290.091268:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391290.091288:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186342912:0@lo:103: 00000100:00100000:0.0:1790391290.091352:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.091453:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186342656:0@lo:103: 00000100:00100000:3.0:1790391290.091601:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186342528:0@lo:103: 00000100:00100000:3.0:1790391290.091639:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391290.091899:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391290.092102:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.092362:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186343040:0@lo:103: 00000100:00100000:3.0:1790391290.092389:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.092417:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186342912 00000100:00100000:3.0:1790391290.092424:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186342912 00010000:00010000:3.0:1790391290.092450:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0d18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d11 expref: 20 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391290.092467:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186342528 00000100:00100000:3.0:1790391290.092470:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186342528 00010000:00010000:3.0:1790391290.092481:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0d9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d96 expref: 21 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391290.092491:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186343040 00000100:00100000:3.0:1790391290.092494:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186343040 00010000:00010000:3.0:1790391290.092503:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0cee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ce7 expref: 22 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391290.092515:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391290.092522:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:3637:x1877361186342912:12345-0@lo:103: 00010000:00010000:3.0:1790391290.092535:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391290.092540:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0d18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d11 expref: 22 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.092549:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d11 expref: 22 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.092573:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0d18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0d11 expref: 22 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.092585:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391290.092634:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:3637:x1877361186342912:12345-0@lo:103: Request processed in 112us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.092641:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391290.092656:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391290.092662:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:3638:x1877361186342528:12345-0@lo:103: 00010000:00010000:3.0:1790391290.092669:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391290.092674:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0d9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d96 expref: 20 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.092682:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d96 expref: 20 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.092691:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566ca00/0x2b1b7949f13e0d9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0d96 expref: 20 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.092699:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391290.092726:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:3638:x1877361186342528:12345-0@lo:103: Request processed in 64us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.092731:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391290.092744:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391290.092749:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:3638:x1877361186343040:12345-0@lo:103: 00010000:00010000:3.0:1790391290.092758:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391290.092762:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0cee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ce7 expref: 18 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.092776:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ce7 expref: 18 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.092785:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0cee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0ce7 expref: 18 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.092793:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391290.092819:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:3638:x1877361186343040:12345-0@lo:103: Request processed in 69us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.092824:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391290.092857:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186342784:0@lo:103: 00000100:00100000:3.0:1790391290.092902:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391290.093094:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186342784 00000100:00100000:0.0:1790391290.093099:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186342784 00010000:00010000:0.0:1790391290.093115:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0d57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d50 expref: 17 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391290.093131:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391290.093137:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:3640:x1877361186342784:12345-0@lo:103: 00010000:00010000:0.0:1790391290.093145:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391290.093148:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0d57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d50 expref: 17 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093157:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d50 expref: 17 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093167:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0d50 expref: 17 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093187:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391290.093220:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:3640:x1877361186342784:12345-0@lo:103: Request processed in 83us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.093227:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790391290.093343:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186342784:0@lo:103: 00000100:00100000:3.0:1790391290.093373:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186342912:0@lo:103: 00000100:00100000:3.0:1790391290.093390:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186342528:0@lo:103: 00000100:00100000:3.0:1790391290.093396:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186343040:0@lo:103: 00000100:00100000:0.0:1790391290.093506:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186342656 00000100:00100000:0.0:1790391290.093511:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186342656 00010000:00010000:0.0:1790391290.093525:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0d73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d6c expref: 16 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391290.093547:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391290.093554:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae989c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:3639:x1877361186342656:12345-0@lo:103: 00010000:00010000:0.0:1790391290.093560:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391290.093564:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0d73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d6c expref: 16 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093572:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d6c expref: 16 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093582:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0d73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0d6c expref: 16 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093593:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093601:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093704:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093714:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093731:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093737:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093742:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566de00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391290.093746:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093753:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093777:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.093788:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391290.093824:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae989c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3639:x1877361186342656:12345-0@lo:103: Request processed in 270us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.093830:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1790391290.093934:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.093943:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.093949:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0df8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790391290.093962:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790391290.096399:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:9503:x1877361186341248:12345-0@lo:253: Request processed in 22677us (23276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.096411:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790391290.096513:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186342656:0@lo:103: 00000100:00100000:0.0:1790391290.096578:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186341248:0@lo:253: 10000000:01000000:0.0:1790391290.096590:0:9503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790391290.096594:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391290.096595:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790391290.096597:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391290.096598:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1790391290.096599:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391290.096600:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391290.096602:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391290.096603:0:9503:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790391290.096605:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391290.096627:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790391290.096646:0:9503:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e52bf9b4000 from lustre-OST0001 10000000:01000000:0.0:1790391290.096675:0:9503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790391290.096678:0:9503:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790391290.096686:0:9503:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e52ae8c99c0 local copy 10000000:01000000:0.0:1790391290.096690:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790391290.096726:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.096736:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.096745:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391290.096763:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343168:0@lo:101: 00000100:00100000:0.0:1790391290.096797:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391290.096828:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77279c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391290.097024:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186343168 00000100:00100000:1.0:1790391290.097036:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186343168 00000100:00100000:1.0:1790391290.097076:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790391290.097084:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+14:9503:x1877361186343168:12345-0@lo:101: 00010000:00010000:1.0:1790391290.097095:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391290.097106:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0dff expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.097127:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0dff expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.097137:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0dff expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.097146:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f7000, rc 0) 00000100:00100000:1.0:1790391290.097776:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:9503:x1877361186343168:12345-0@lo:101: Request processed in 691us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391290.097783:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790391290.098065:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343168:0@lo:101: 00010000:00010000:0.0:1790391290.098080:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.098091:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391290.098282:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343296:0@lo:501: 00000100:00100000:0.0:1790391290.098317:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391290.098357:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391290.098397:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186343296 00000100:00100000:3.0:1790391290.098403:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186343296 00000100:00100000:3.0:1790391290.098439:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790391290.098445:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:9503:x1877361186343296:12345-0@lo:501: 00000100:00100000:3.0:1790391290.098512:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:9503:x1877361186343296:12345-0@lo:501: Request processed in 67us (195us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790391290.098518:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790391290.098576:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343296:0@lo:501: 10000000:01000000:1.0:1790391290.098589:0:9503:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790391290.098606:0:9503:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790391290.098612:0:9503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.098631:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.098638:0:9503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.098676:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790391290.098700:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e52bf9b4000 10000000:01000000:1.0:1790391290.098705:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790391290.098709:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790391290.098712:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790391290.098716:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790391290.098719:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790391290.098737:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.098744:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.098751:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391290.098763:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343424:0@lo:101: 00000100:00100000:1.0:1790391290.098789:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391290.098810:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186343424 00000100:00100000:1.0:1790391290.098814:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186343424 00000100:00100000:1.0:1790391290.098834:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790391290.098852:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:9503:x1877361186343424:12345-0@lo:101: 00010000:00010000:1.0:1790391290.098859:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391290.098870:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0e14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0e0d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.098906:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e0d expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.099085:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e0d expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.099093:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f7600, rc 0) 00000100:00100000:1.0:1790391290.099118:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186343424:12345-0@lo:101: Request processed in 266us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391290.099124:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790391290.099148:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290000d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391290.099161:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343424:0@lo:101: 00010000:00010000:1.0:1790391290.099171:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.099191:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391290.099243:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343552:0@lo:501: 00000100:00100000:1.0:1790391290.099267:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391290.099287:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186343552 00000100:00100000:1.0:1790391290.099291:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186343552 00000100:00100000:1.0:1790391290.099307:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790391290.099313:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186343552:12345-0@lo:501: 00000100:00100000:1.0:1790391290.099400:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186343552:12345-0@lo:501: Request processed in 87us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391290.099407:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790391290.099427:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391290.099439:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343552:0@lo:501: 00000100:00100000:1.0:1790391290.099468:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343680:0@lo:503: 00000100:00100000:1.0:1790391290.099507:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391290.099526:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186343680 00000100:00100000:1.0:1790391290.099529:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186343680 00000100:00100000:1.0:1790391290.099546:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790391290.099550:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186343680:12345-0@lo:503: 00000100:00100000:1.0:1790391290.099624:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186343680:12345-0@lo:503: Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391290.099632:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790391290.099669:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391290.099682:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343680:0@lo:503: 00000040:00080000:1.0:1790391290.099962:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391290.100034:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343808:0@lo:502: 00000100:00100000:1.0:1790391290.100068:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391290.100089:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186343808 00000100:00100000:1.0:1790391290.100093:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186343808 00000100:00100000:1.0:1790391290.100111:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790391290.100116:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186343808:12345-0@lo:502: 00000100:00100000:1.0:1790391290.100182:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186343808:12345-0@lo:502: Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391290.100189:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790391290.100217:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391290.100229:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343808:0@lo:502: 00000040:00080000:1.0:1790391290.100437:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790391290.100459:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790391290.100471:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790391290.100494:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790391290.100507:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790391290.100519:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790391290.100537:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343936:0@lo:502: 00000100:00100000:1.0:1790391290.100569:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391290.100589:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186343936 00000100:00100000:1.0:1790391290.100593:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186343936 00000100:00100000:1.0:1790391290.100609:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790391290.100615:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186343936:12345-0@lo:502: 00000100:00100000:1.0:1790391290.100671:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186343936:12345-0@lo:502: Request processed in 55us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391290.100677:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790391290.100703:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391290.100715:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186343936:0@lo:502: 00000040:00080000:1.0:1790391290.100746:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790391290.100753:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00010000:00010000:3.0:1790391290.101263:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391290.101271:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.101280:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee200 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391290.101284:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.101292:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391290.101299:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391290.101304:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790391290.101327:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.101333:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391290.101360:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.101374:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee200/0x2b1b7949f13e0dff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2b1b7949f13e0e06 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.101387:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391290.101389:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391290.101391:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391290.101404:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186344064:0@lo:103: 00000100:00100000:3.0:1790391290.101438:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.101475:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186344064 00000100:00100000:3.0:1790391290.101480:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186344064 00000100:00100000:3.0:1790391290.101517:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391290.101524:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:3639:x1877361186344064:12345-0@lo:103: 00010000:00010000:3.0:1790391290.101534:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391290.101546:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0dff expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.101557:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391290.101585:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3639:x1877361186344064:12345-0@lo:103: Request processed in 60us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.101590:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391290.101732:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186344064:0@lo:103: 00000020:01000000:1.0:1790391290.102405:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790391290.102413:0:9514:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1790391290.102420:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391290.102422:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790391290.102428:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391290.102443:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e52b5cacd40) 00000020:00000080:1.0:1790391290.102465:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790391290.102472:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790391290.102550:0:9514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52bf9b4000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790391290.102559:0:9514:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790391290.102565:0:9514:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2b1b7949f13e0e22 00010000:00010000:3.0:1790391290.111104:0:9514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1790391290.111513:0:9514:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1790391290.115398:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790391290.115814:0:9514:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1790391290.122037:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1790391290.122302:0:9514:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1790391290.128475:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1790391290.130044:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790391290.130055:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391290.130061:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391290.130064:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790391290.130067:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391290.130072:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391290.130073:0:9514:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790391290.130077:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391290.130078:0:9514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790391290.130101:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391290.130104:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391290.130105:0:9514:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790391290.130108:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790391290.130381:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1790391290.130408:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790391290.130426:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.130445:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391290.130454:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52bf9b4000 from 1 10000000:01000000:1.0:1790391290.130457:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391290.130491:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.130499:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.130510:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391290.130534:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344192:0@lo:101: 00000100:00100000:1.0:1790391290.130600:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391290.130655:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1790391290.130770:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186344192 00000100:00100000:2.0:1790391290.130778:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186344192 00000100:00100000:2.0:1790391290.130830:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790391290.130839:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:9503:x1877361186344192:12345-0@lo:101: 00010000:00010000:2.0:1790391290.130852:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391290.130866:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0e30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0e29 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.130908:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e29 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.130981:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e29 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391290.131003:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e529566de00, rc 0) 00000100:00100000:2.0:1790391290.131044:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186344192:12345-0@lo:101: Request processed in 206us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391290.131051:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790391290.131426:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344192:0@lo:101: 00010000:00010000:1.0:1790391290.131440:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391290.131450:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391290.131527:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344320:0@lo:501: 00000100:00100000:1.0:1790391290.131556:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391290.131585:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1790391290.131697:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186344320 00000100:00100000:3.0:1790391290.131702:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186344320 00000100:00100000:3.0:1790391290.131738:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790391290.131745:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5289dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186344320:12345-0@lo:501: 00000100:00100000:3.0:1790391290.131852:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5289dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186344320:12345-0@lo:501: Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.131860:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790391290.132085:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344320:0@lo:501: 00000100:00100000:1.0:1790391290.132114:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344448:0@lo:503: 00000100:00100000:1.0:1790391290.132153:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391290.132243:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1790391290.132285:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186344448 00000100:00100000:3.0:1790391290.132289:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186344448 00000100:00100000:3.0:1790391290.132321:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790391290.132328:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186344448:12345-0@lo:503: 00000100:00100000:3.0:1790391290.132415:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186344448:12345-0@lo:503: Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.132422:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790391290.132463:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344448:0@lo:503: 00000040:00080000:3.0:1790391290.132800:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391290.133758:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344576:0@lo:502: 00000100:00100000:2.0:1790391290.133910:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391290.134008:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77dbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391290.134063:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186344576 00000100:00100000:1.0:1790391290.134070:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186344576 00000100:00100000:1.0:1790391290.134106:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790391290.134114:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186344576:12345-0@lo:502: 00000100:00100000:1.0:1790391290.134286:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186344576:12345-0@lo:502: Request processed in 172us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391290.134294:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790391290.134379:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344576:0@lo:502: 00000040:00080000:2.0:1790391290.134598:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790391290.135276:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790391290.135311:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344704:0@lo:502: 00000100:00100000:2.0:1790391290.135368:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391290.136038:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823daf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391290.142129:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186344704 00000100:00100000:1.0:1790391290.142145:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186344704 00000100:00100000:1.0:1790391290.142761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790391290.142773:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186344704:12345-0@lo:502: 00000100:00100000:1.0:1790391290.142982:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186344704:12345-0@lo:502: Request processed in 211us (7613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391290.142991:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790391290.143798:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344704:0@lo:502: 00000040:00080000:3.0:1790391290.143915:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790391290.143936:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1790391290.144550:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391290.144559:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391290.144561:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790391290.144567:0:9518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52bf9b4000 00000020:00000080:2.0:1790391290.144570:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790391290.144582:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391290.144585:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391290.144586:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790391290.144589:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790391290.145219:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790391290.145243:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391290.145262:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.145273:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391290.145346:0:9503:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790391290.145349:0:9503:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e52bf9b4000 10000000:01000000:3.0:1790391290.145353:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e52bf9b4000 10000000:01000000:3.0:1790391290.145358:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391290.145363:0:9503:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52bf9b4000 from 1 10000000:01000000:3.0:1790391290.145366:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391290.145398:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.145407:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.145419:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391290.145440:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344832:0@lo:101: 00000100:00100000:3.0:1790391290.145498:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.145830:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77db780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391290.146035:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186344832 00000100:00100000:0.0:1790391290.146044:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186344832 00000100:00100000:0.0:1790391290.146098:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790391290.146107:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9503:x1877361186344832:12345-0@lo:101: 00010000:00010000:0.0:1790391290.146119:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391290.146132:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0e3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0e37 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.146156:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e37 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.146167:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e37 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.146176:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef400, rc 0) 00000100:00100000:0.0:1790391290.146216:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186344832:12345-0@lo:101: Request processed in 110us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.146223:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790391290.147166:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344832:0@lo:101: 00010000:00010000:3.0:1790391290.147185:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.147195:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391290.147288:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344960:0@lo:501: 00000100:00100000:3.0:1790391290.147325:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.147377:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77db780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391290.147393:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186344960 00000100:00100000:3.0:1790391290.147398:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186344960 00000100:00100000:3.0:1790391290.147422:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790391290.147428:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186344960:12345-0@lo:501: 00000100:00100000:3.0:1790391290.147524:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186344960:12345-0@lo:501: Request processed in 96us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.147531:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790391290.147565:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186344960:0@lo:501: 00000100:00100000:3.0:1790391290.147589:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186345088:0@lo:503: 00000100:00100000:3.0:1790391290.147698:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.147713:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77db780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391290.147727:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186345088 00000100:00100000:3.0:1790391290.147730:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186345088 00000100:00100000:3.0:1790391290.147746:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790391290.147752:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186345088:12345-0@lo:503: 00000100:00100000:3.0:1790391290.147982:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186345088:12345-0@lo:503: Request processed in 84us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.147990:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790391290.148030:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186345088:0@lo:503: 00000040:00080000:3.0:1790391290.148412:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391290.148472:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186345216:0@lo:502: 00000100:00100000:3.0:1790391290.148507:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.148698:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77db780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391290.148987:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186345216 00000100:00100000:1.0:1790391290.148992:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186345216 00000100:00100000:1.0:1790391290.149024:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790391290.149031:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186345216:12345-0@lo:502: 00000100:00100000:1.0:1790391290.149487:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186345216:12345-0@lo:502: Request processed in 455us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391290.149495:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790391290.149789:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186345216:0@lo:502: 00000040:00080000:3.0:1790391290.150330:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790391290.150379:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790391290.150394:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790391290.150423:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790391290.150437:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790391290.150449:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790391290.150461:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790391290.150474:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790391290.150484:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790391290.150495:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790391290.150507:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790391290.150518:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790391290.150528:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790391290.150539:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790391290.150550:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790391290.150561:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790391290.150571:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790391290.150581:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790391290.150592:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790391290.150716:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790391290.150735:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790391290.150747:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790391290.150758:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790391290.150770:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790391290.150780:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1790391290.150790:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1790391290.150800:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1790391290.150810:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1790391290.150819:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1790391290.150829:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1790391290.150855:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1790391290.150868:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1790391290.150901:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1790391290.150984:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1790391290.151011:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1790391290.151039:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1790391290.151128:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1790391290.151144:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1790391290.151158:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1790391290.151170:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1790391290.151181:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1790391290.151194:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1790391290.151207:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1790391290.151219:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1790391290.151231:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1790391290.151244:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1790391290.151281:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186345344:0@lo:502: 00000100:00100000:3.0:1790391290.151357:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.151488:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77db780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391290.151747:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186345344 00000100:00100000:0.0:1790391290.151755:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186345344 00000100:00100000:0.0:1790391290.151807:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790391290.151816:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186345344:12345-0@lo:502: 00000100:00100000:0.0:1790391290.152208:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186345344:12345-0@lo:502: Request processed in 393us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.152216:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790391290.153257:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186345344:0@lo:502: 00000040:00080000:3.0:1790391290.153354:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1790391290.153366:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1790391290.153805:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790391290.153817:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e52b9d70000) 00000020:00000080:2.0:1790391290.153843:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1790391290.153948:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52bf9b4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790391290.153953:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52bf9b4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790391290.153955:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52bf9b4000 3 00010000:00080000:2.0:1790391290.153991:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5182f5b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391290.155792:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1790391290.155962:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790391290.156000:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790391290.156009:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2b1b7949f13e0e4c 00000100:00080000:2.0:1790391290.156017:0:9519:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391290.156022:0:9519:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e5182f5b000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391290.156049:0:9519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e529233a300 x1877361186345472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391290.156070:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790391290.157508:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186345472:0@lo:38: 00000100:00100000:3.0:1790391290.157580:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.157644:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186345472 00000100:00100000:3.0:1790391290.157652:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186345472 00000100:00100000:3.0:1790391290.157683:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391290.157690:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186345472:12345-0@lo:38: 00010000:00080000:3.0:1790391290.157715:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:3.0:1790391290.157746:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2b1b7949f13e0e53 00000004:00100000:3.0:1790391290.157760:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790391290.157790:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9e52b77e7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391290.157837:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1877361186345472:12345-0@lo:38: Request processed in 146us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.157850:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391290.157986:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186345600:0@lo:400: 00000100:00100000:3.0:1790391290.158024:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.158045:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186346112:0@lo:400: 00000100:00100000:3.0:1790391290.158078:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.158095:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790391290.158101:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186345984:0@lo:400: 00000100:00100000:3.0:1790391290.158123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.158151:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186346496:0@lo:400: 00000100:00100000:3.0:1790391290.158191:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.158218:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186345728:0@lo:400: 00000100:00100000:3.0:1790391290.158237:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.158255:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186346240:0@lo:400: 00000100:00100000:3.0:1790391290.158273:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.158287:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790391290.158292:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186345856:0@lo:400: 00000100:00100000:3.0:1790391290.158311:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.158320:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186346368:0@lo:400: 00000100:00100000:3.0:1790391290.158354:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.158383:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186345600 00000100:00100000:3.0:1790391290.158388:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186345600 00000100:00100000:3.0:1790391290.158413:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186346112 00000100:00100000:3.0:1790391290.158415:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186346112 00000100:00100000:3.0:1790391290.158438:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186346240 00000100:00100000:3.0:1790391290.158440:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186346240 00000100:00100000:3.0:1790391290.158451:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186345856 00000100:00100000:3.0:1790391290.158459:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186345856 00000100:00100000:3.0:1790391290.158475:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790391290.158481:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186345600:12345-0@lo:400: 00000100:00100000:3.0:1790391290.158518:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186345600:12345-0@lo:400: Request processed in 37us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.158524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790391290.158536:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391290.158542:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186346112:12345-0@lo:400: 00000100:00100000:3.0:1790391290.158566:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186346112:12345-0@lo:400: Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.158572:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391290.158581:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790391290.158587:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186346240:12345-0@lo:400: 00000100:00100000:3.0:1790391290.158615:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186346240:12345-0@lo:400: Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.158620:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790391290.158630:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391290.158635:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186345856:12345-0@lo:400: 00000100:00100000:3.0:1790391290.158660:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186345856:12345-0@lo:400: Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.158666:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391290.158682:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186345984 00000100:00100000:3.0:1790391290.158685:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186345984 00000100:00100000:3.0:1790391290.158706:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186345728 00000100:00100000:3.0:1790391290.158709:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186345728 00000100:00100000:3.0:1790391290.158719:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790391290.158724:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186345984:12345-0@lo:400: 00000100:00100000:3.0:1790391290.158758:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186345984:12345-0@lo:400: Request processed in 33us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.158764:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790391290.158775:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790391290.158780:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186345728:12345-0@lo:400: 00000100:00100000:3.0:1790391290.158803:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186345728:12345-0@lo:400: Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.158808:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790391290.158824:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186346496 00000100:00100000:3.0:1790391290.158827:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186346496 00000100:00100000:3.0:1790391290.158848:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186346368 00000100:00100000:3.0:1790391290.158851:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186346368 00000100:00100000:3.0:1790391290.158864:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391290.158870:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186346496:12345-0@lo:400: 00000100:00100000:3.0:1790391290.158916:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186346496:12345-0@lo:400: Request processed in 46us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.158922:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391290.158932:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391290.158938:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186346368:12345-0@lo:400: 00000100:00100000:3.0:1790391290.158963:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186346368:12345-0@lo:400: Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.158968:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1790391290.158989:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391290.158994:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391290.158996:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790391290.159032:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e529233a300 x1877361186345472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391290.159053:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391290.159062:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1790391290.159069:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790391290.159073:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790391290.159076:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790391290.159082:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186345472:0@lo:38: 00010000:00080000:3.0:1790391290.159112:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf94b100 x1877361186345856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391290.159122:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186345856:0@lo:400: 00010000:00080000:3.0:1790391290.159132:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206d880 x1877361186346368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391290.159141:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186346368:0@lo:400: 00000100:00100000:3.0:1790391290.159150:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186345728:0@lo:400: 00010000:00080000:3.0:1790391290.159160:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206ed80 x1877361186346240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391290.159168:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186346240:0@lo:400: 00000100:00100000:3.0:1790391290.159197:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186345984:0@lo:400: 00010000:00080000:3.0:1790391290.159206:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e518206f100 x1877361186346496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391290.159215:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186346496:0@lo:400: 00010000:00080000:3.0:1790391290.159224:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf948000 x1877361186345600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391290.159242:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186345600:0@lo:400: 00010000:00080000:3.0:1790391290.159254:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf94bb80 x1877361186346112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391290.159261:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186346112:0@lo:400: 00000020:01000004:3.0:1790391290.163467:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790391290.163485:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e529e9799c0) 00000020:00000080:3.0:1790391290.163510:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1790391290.163611:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52bf9b4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790391290.163626:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52bf9b4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790391290.163628:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52bf9b4000 3 00010000:00080000:3.0:1790391290.163658:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52b9937000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391290.166185:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1790391290.166439:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1790391290.166483:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790391290.166496:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2b1b7949f13e0e61 00000100:00080000:3.0:1790391290.166507:0:9519:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790391290.166512:0:9519:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e52b9937000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391290.166547:0:9519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51830a5500 x1877361186346624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391290.166576:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790391290.166829:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1877361186346624:0@lo:38: 00000100:00100000:0.0:1790391290.166946:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391290.167162:0:9520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9520:1877361186346752:0@lo:901: 00000100:00100000:2.0:1790391290.167198:0:9520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391290.167214:0:9520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391290.167318:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186346752 00000100:00100000:0.0:1790391290.167326:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186346752 00000100:00100000:0.0:1790391290.167402:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391290.167411:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9520:x1877361186346752:12345-0@lo:901: 00000100:00100000:0.0:1790391290.167520:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9520:x1877361186346752:12345-0@lo:901: Request processed in 109us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.167528:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790391290.167589:0:9520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5292339180 x1877361186346752/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790391306 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391290.167601:0:9520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9520:1877361186346752:0@lo:901: 00000100:00080000:2.0:1790391290.167700:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1790391290.168370:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1790391290.168435:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1790391290.168462:0:9503:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790391290.168478:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391290.168500:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790391290.168544:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790391290.168546:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790391290.168547:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391290.168548:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391290.168550:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391290.168551:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391290.168552:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790391290.168554:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790391290.168555:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790391290.168557:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391290.168558:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790391290.168563:0:9503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1790391290.168565:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790391290.168566:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790391290.168567:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391290.168568:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391290.168569:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391290.168570:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391290.168571:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790391290.168572:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790391290.168573:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790391290.168574:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391290.168575:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790391290.168593:0:9503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790391290.168604:0:9503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186346880:0@lo:253: 00000100:00100000:3.0:1790391290.168664:0:9503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391290.168685:0:9503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77db180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391290.168711:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186346880 00000100:00100000:3.0:1790391290.168716:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186346880 00000100:00100000:3.0:1790391290.168747:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790391290.168754:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186346880:12345-0@lo:253: 20000000:01000000:3.0:1790391290.168784:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790391290.168797:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1790391290.170053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186346624 00000100:00100000:3.0:1790391290.170063:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186346624 00000100:00100000:3.0:1790391290.170101:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391290.170107:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186346624:12345-0@lo:38: 00010000:00080000:3.0:1790391290.170132:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:3.0:1790391290.170164:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2b1b7949f13e0e68 00000004:00100000:3.0:1790391290.170180:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790391290.170210:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9e5181f60800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391290.170279:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1877361186346624:12345-0@lo:38: Request processed in 170us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.170286:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790391290.170332:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51830a5500 x1877361186346624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391290.170380:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391290.170388:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1790391290.170396:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790391290.170400:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1790391290.170403:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b9937000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790391290.170409:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1877361186346624:0@lo:38: 20000000:01000000:3.0:1790391290.176073:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790391290.176088:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790391290.176388:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9503:x1877361186346880:12345-0@lo:253: Request processed in 7629us (7718us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391290.176401:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790391290.176477:0:9503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9503:1877361186346880:0@lo:253: 10000000:01000000:3.0:1790391290.176490:0:9503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790391290.176493:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790391290.176495:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790391290.176496:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391290.176497:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391290.176499:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391290.176500:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391290.176501:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790391290.176503:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790391290.176504:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790391290.176506:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391290.176508:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790391290.176520:0:9503:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1790391290.176758:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790391290.176763:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790391290.176784:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.176800:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e0d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d5e expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.176807:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0da4 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.176814:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.176862:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0da4 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.176893:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0dab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0da4 expref: 16 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391290.176908:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186347008:0@lo:104: 00000100:00100000:0.0:1790391290.177234:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391290.177278:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e0d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0d5e expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.177294:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e0d65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d5e expref: 16 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391290.177304:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186347136:0@lo:104: 00000100:00100000:0.0:1790391290.177326:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391290.177358:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391290.177378:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186347008 00000100:00100000:0.0:1790391290.177383:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186347008 00000100:00100000:0.0:1790391290.177413:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186347136 00000100:00100000:0.0:1790391290.177416:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186347136 00000100:00100000:0.0:1790391290.177429:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391290.177437:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6528:x1877361186347008:12345-0@lo:104: 00010000:00010000:0.0:1790391290.177449:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.177490:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790391290.177496:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:6528:x1877361186347008:12345-0@lo:104: Request processed in 60us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.177502:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391290.177516:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790391290.177521:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6528:x1877361186347136:12345-0@lo:104: 00010000:00010000:0.0:1790391290.177529:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.177562:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790391290.177566:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:6528:x1877361186347136:12345-0@lo:104: Request processed in 46us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.179514:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1790391290.179554:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391290.179561:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.179570:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f7400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391290.179574:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.179584:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391290.179592:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391290.179598:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391290.179650:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.179657:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391290.179681:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.179688:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0da4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0dab expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.179700:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391290.179703:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.179720:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391290.179727:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.179734:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391290.179739:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391290.179744:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391290.179757:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.179762:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391290.179777:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.179783:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295144600/0x2b1b7949f13e0d5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d65 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.179808:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391290.179810:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391290.179812:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391290.179819:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391290.179844:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391290.179858:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186347264:0@lo:103: 00000100:00100000:0.0:1790391290.180128:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391290.180182:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186347264 00000100:00100000:0.0:1790391290.180208:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186347264 00010000:00010000:0.0:1790391290.180233:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0dab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0da4 expref: 17 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391290.180260:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391290.180268:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:3639:x1877361186347264:12345-0@lo:103: 00010000:00010000:0.0:1790391290.180279:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391290.180283:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0dab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0da4 expref: 17 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180293:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0dab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0da4 expref: 17 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180307:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391290.180349:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:3639:x1877361186347264:12345-0@lo:103: Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.180355:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391290.180374:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391290.180382:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186347392:0@lo:103: 00000100:00100000:0.0:1790391290.180404:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391290.180428:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186347392 00000100:00100000:0.0:1790391290.180432:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186347392 00010000:00010000:0.0:1790391290.180444:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e0d65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d5e expref: 17 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391290.180460:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790391290.180465:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:3638:x1877361186347392:12345-0@lo:103: 00010000:00010000:0.0:1790391290.180472:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391290.180475:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e0d65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d5e expref: 17 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180487:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e0d65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d5e expref: 17 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180498:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180506:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790391290.180519:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012671002s 00010000:00010000:0.0:1790391290.180523:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180530:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180536:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180542:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180547:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391290.180550:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180557:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180565:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180585:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391290.180612:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:3638:x1877361186347392:12345-0@lo:103: Request processed in 146us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391290.180618:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790391290.180649:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186347392:0@lo:103: 00000100:00100000:0.0:1790391290.180673:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186347264:0@lo:103: 00010000:00010000:0.0:1790391290.180698:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0dab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0da4 expref: 16 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391290.180707:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186347008:0@lo:104: 00010000:00010000:0.0:1790391290.180716:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e0d65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0d5e expref: 15 pid: 6507 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391290.180724:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1877361186347136:0@lo:104: 00010000:00010000:0.0:1790391290.180738:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180746:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180752:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391290.180758:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eee000/0x2b1b7949f13e0e6f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1790391290.188595:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1790391290.190058:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1790391290.190629:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1790391290.190784:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1790391290.191060:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1790391290.191280:0:9503:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1790391290.193315:0:9503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790391290.202481:0:9503:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790391290.202491:0:9503:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790391290.202529:0:9503:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790391290.202569:0:9503:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790391290.202611:0:9503:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1790391290.202641:0:9503:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1790391290.203491:0:9503:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391290.203681:0:9503:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1790391290.824365:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790391291.044752:0:9575:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391291.045035:0:9575:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790391291.855556:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391291.912289:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186347520:0@lo:13: 00000100:00100000:0.0:1790391291.912379:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391291.912539:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186347520 00000100:00100000:1.0:1790391291.912547:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186347520 00000100:00100000:1.0:1790391291.912608:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391291.912618:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186347520:12345-0@lo:13: 00002000:00000024:1.0:1790391291.912646:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391291.912704:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186347520:12345-0@lo:13: Request processed in 87us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391291.912711:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790391291.912748:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229c000 x1877361186347520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391291.912766:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186347520:0@lo:13: 00000100:00100000:3.0:1790391291.915744:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391291.915765:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186347648:0@lo:13: 00000100:00100000:3.0:1790391291.915828:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391291.916166:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186347648 00000100:00100000:3.0:1790391291.916173:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186347648 00000100:00100000:3.0:1790391291.916216:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391291.916224:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186347648:12345-0@lo:13: 00002000:00000024:3.0:1790391291.916252:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391291.916301:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186347648:12345-0@lo:13: Request processed in 68us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391291.916308:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1790391291.916356:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a7800 x1877361186347648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391291.916374:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186347648:0@lo:13: 00000100:00100000:1.0:1790391291.922225:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391291.922252:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186347776:0@lo:41: 00000100:00100000:1.0:1790391291.922655:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391291.922748:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186347776 00000100:00100000:0.0:1790391291.922756:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186347776 00000100:00100000:0.0:1790391291.922815:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790391291.922824:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186347776:12345-0@lo:41: 00000004:00000024:0.0:1790391291.922856:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1790391291.923060:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186347776:12345-0@lo:41: Request processed in 237us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391291.923529:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790391291.923936:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186347776:0@lo:41: 00010000:00010000:0.0:1790391292.875493:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391293.898027:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391293.960220:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186347904:0@lo:41: 00000100:00100000:3.0:1790391293.960328:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391293.960496:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186347904 00000100:00100000:2.0:1790391293.960504:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186347904 00000100:00100000:2.0:1790391293.960551:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391293.960560:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186347904:12345-0@lo:41: 00000004:00000024:2.0:1790391293.960593:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1790391293.960645:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186347904:12345-0@lo:41: Request processed in 87us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391293.960651:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391293.960685:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186347904:0@lo:41: 00010000:00010000:1.0:1790391294.921308:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391295.496168:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186348416:0@lo:400: 00000100:00100000:1.0:1790391295.496314:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186348032:0@lo:400: 00000100:00100000:1.0:1790391295.496356:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.496413:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186348544:0@lo:400: 00000100:00100000:1.0:1790391295.496439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.496458:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186349056:0@lo:400: 00000100:00100000:1.0:1790391295.496479:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.496518:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186348032 00000100:00100000:1.0:1790391295.496526:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186348032 00000100:00100000:1.0:1790391295.496582:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790391295.496591:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3638:x1877361186348032:12345-0@lo:400: 00000100:00100000:1.0:1790391295.496651:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3638:x1877361186348032:12345-0@lo:400: Request processed in 61us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.496657:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790391295.496689:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186348544 00000100:00100000:1.0:1790391295.496693:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186348544 00000100:00100000:1.0:1790391295.496730:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790391295.496736:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186348544:12345-0@lo:400: 00000100:00100000:1.0:1790391295.496767:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186348544:12345-0@lo:400: Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.496773:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790391295.497104:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186348032:0@lo:400: 00000100:00100000:1.0:1790391295.497120:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186348544:0@lo:400: 00000100:00100000:3.0:1790391295.497184:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.497217:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186348928:0@lo:400: 00000100:00100000:1.0:1790391295.497308:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186348416 00000100:00100000:1.0:1790391295.497313:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186348416 00000100:00100000:1.0:1790391295.497344:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391295.497350:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186348416:12345-0@lo:400: 00000100:00100000:1.0:1790391295.497395:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186348416:12345-0@lo:400: Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.497401:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790391295.497497:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790391295.497598:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a4e00 x1877361186348416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391295.497610:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186348416:0@lo:400: 00000100:00100000:3.0:1790391295.497631:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186348160:0@lo:400: 00000100:00100000:3.0:1790391295.497655:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.497675:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186348672:0@lo:400: 00000100:00100000:3.0:1790391295.497695:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.497779:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186349184:0@lo:400: 00000100:00100000:3.0:1790391295.497818:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.497833:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790391295.497849:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186348288:0@lo:400: 00000100:00100000:3.0:1790391295.498017:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.498040:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186348800:0@lo:400: 00000100:00100000:3.0:1790391295.498062:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.498073:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186349312:0@lo:400: 00000100:00100000:3.0:1790391295.498091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.498117:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186349056 00000100:00100000:3.0:1790391295.498121:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186349056 00000100:00100000:3.0:1790391295.498163:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186348928 00000100:00100000:3.0:1790391295.498166:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186348928 00000100:00100000:3.0:1790391295.498181:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391295.498188:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186349056:12345-0@lo:400: 00000100:00100000:3.0:1790391295.498295:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186349056:12345-0@lo:400: Request processed in 37us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.498303:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391295.498317:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391295.498323:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186348928:12345-0@lo:400: 00000100:00100000:3.0:1790391295.498357:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186348928:12345-0@lo:400: Request processed in 34us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.498363:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790391295.498490:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518206f100 x1877361186349056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.498502:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186349056:0@lo:400: 00000100:00100000:3.0:1790391295.498598:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186348160 00000100:00100000:3.0:1790391295.498601:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186348160 00000100:00100000:3.0:1790391295.498618:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186348672 00000100:00100000:3.0:1790391295.498620:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186348672 00000100:00100000:3.0:1790391295.498630:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186349184 00000100:00100000:3.0:1790391295.498632:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186349184 00000100:00100000:3.0:1790391295.498640:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186348800 00000100:00100000:3.0:1790391295.498643:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186348800 00000100:00100000:3.0:1790391295.498652:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186349312 00000100:00100000:3.0:1790391295.498659:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186349312 00000100:00100000:3.0:1790391295.498673:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391295.498678:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186348160:12345-0@lo:400: 00000100:00100000:3.0:1790391295.498857:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186348160:12345-0@lo:400: Request processed in 177us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.498863:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391295.498952:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391295.498958:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186348672:12345-0@lo:400: 00000100:00100000:3.0:1790391295.498984:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186348672:12345-0@lo:400: Request processed in 27us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.498990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391295.498998:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391295.499003:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186349184:12345-0@lo:400: 00000100:00100000:3.0:1790391295.499022:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186349184:12345-0@lo:400: Request processed in 19us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.499027:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391295.499035:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391295.499039:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186348800:12345-0@lo:400: 00000100:00100000:3.0:1790391295.499077:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186348800:12345-0@lo:400: Request processed in 37us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.499083:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391295.499094:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790391295.499100:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186349312:12345-0@lo:400: 00000100:00100000:3.0:1790391295.499126:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186349312:12345-0@lo:400: Request processed in 26us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.499132:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790391295.499173:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186348288 00000100:00100000:3.0:1790391295.499177:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186348288 00000100:00100000:3.0:1790391295.499199:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790391295.499205:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186348288:12345-0@lo:400: 00000100:00100000:3.0:1790391295.499312:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186348288:12345-0@lo:400: Request processed in 107us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.499319:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1790391295.499365:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a6d80 x1877361186348928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790391295.499637:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790391295.499641:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52b77e2800 from 39 10000000:01000000:0.0:1790391295.499645:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790391295.499678:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.499688:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.499699:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391295.499770:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186349440:0@lo:101: 00000100:00100000:0.0:1790391295.499860:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.499958:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776c840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.500072:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186348928:0@lo:400: 00000100:00100000:3.0:1790391295.500096:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186349440 00000100:00100000:3.0:1790391295.500100:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186349440 00000100:00100000:3.0:1790391295.500127:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790391295.500133:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186349440:12345-0@lo:101: 00010000:00010000:3.0:1790391295.500141:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391295.500154:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0e7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0e76 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.500176:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e76 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.500187:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e76 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.500195:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031600, rc 0) 00000100:00100000:3.0:1790391295.500295:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186349440:12345-0@lo:101: Request processed in 153us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.500301:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1790391295.502070:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391295.502078:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391295.502092:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391295.502159:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186349440:0@lo:101: 00010000:00010000:2.0:1790391295.502181:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.502193:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391295.503193:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186349568:0@lo:501: 00000100:00100000:2.0:1790391295.503320:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.503356:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.503374:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186349568 00000100:00100000:2.0:1790391295.503447:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186349568 00000100:00100000:2.0:1790391295.503492:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790391295.503501:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186349568:12345-0@lo:501: 00000100:00100000:2.0:1790391295.503942:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186349568:12345-0@lo:501: Request processed in 440us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.503949:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790391295.503989:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186349568:0@lo:501: 00000100:00100000:2.0:1790391295.504019:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186349696:0@lo:503: 00000100:00100000:2.0:1790391295.504063:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.504077:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.504088:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186349696 00000100:00100000:2.0:1790391295.504091:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186349696 00000100:00100000:2.0:1790391295.504112:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790391295.504118:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186349696:12345-0@lo:503: 00000100:00100000:2.0:1790391295.504200:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186349696:12345-0@lo:503: Request processed in 82us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.504213:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00080000:1.0:1790391295.505362:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a5180 x1877361186348160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.505519:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186348160:0@lo:400: 00010000:00080000:1.0:1790391295.505920:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a6300 x1877361186348672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.505931:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186348672:0@lo:400: 00010000:00080000:1.0:1790391295.505949:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518206ed80 x1877361186349184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.505958:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186349184:0@lo:400: 00000100:00100000:1.0:1790391295.505988:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186348288:0@lo:400: 00010000:00080000:1.0:1790391295.506003:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a4700 x1877361186348800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.506011:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186348800:0@lo:400: 00010000:00080000:1.0:1790391295.506026:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518206d880 x1877361186349312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.506033:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186349312:0@lo:400: 00000100:00100000:2.0:1790391295.506129:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186349696:0@lo:503: 00000100:00100000:1.0:1790391295.508344:0:9772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9772:1877361186349824:0@lo:502: 00000100:00100000:1.0:1790391295.508492:0:9772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.508639:0:9772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330d900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.509906:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186349824 00000100:00100000:0.0:1790391295.509915:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186349824 00000100:00100000:0.0:1790391295.510020:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790391295.510029:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9772:x1877361186349824:12345-0@lo:502: 00000100:00100000:0.0:1790391295.510177:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9772:x1877361186349824:12345-0@lo:502: Request processed in 148us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.510185:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790391295.510560:0:9772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9772:1877361186349824:0@lo:502: 00000100:00100000:3.0:1790391295.510621:0:9772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9772:1877361186349952:0@lo:502: 00000100:00100000:3.0:1790391295.510660:0:9772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.520646:0:9772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.520987:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186349952 00000100:00100000:1.0:1790391295.520997:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186349952 00000100:00100000:1.0:1790391295.521046:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790391295.521056:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9772:x1877361186349952:12345-0@lo:502: 00000100:00100000:1.0:1790391295.521210:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:9772:x1877361186349952:12345-0@lo:502: Request processed in 155us (10548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.521217:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790391295.521655:0:9772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9772:1877361186349952:0@lo:502: 00000040:00080000:1.0:1790391295.521898:0:9772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1790391295.522064:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1790391295.522097:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790391295.522107:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.522119:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391295.522128:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790391295.522131:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1790391295.522134:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790391295.522164:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.522172:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.522181:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391295.522199:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350080:0@lo:101: 00000100:00100000:3.0:1790391295.522250:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.522282:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.522494:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186350080 00000100:00100000:1.0:1790391295.522499:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186350080 00000100:00100000:1.0:1790391295.522534:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790391295.522551:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186350080:12345-0@lo:101: 00010000:00010000:1.0:1790391295.522561:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391295.522572:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.522595:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e84 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.522605:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e84 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.522614:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f7000, rc 0) 00000100:00100000:1.0:1790391295.522651:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186350080:12345-0@lo:101: Request processed in 100us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.522657:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790391295.522947:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350080:0@lo:101: 00010000:00010000:3.0:1790391295.522959:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.522978:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391295.523035:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350208:0@lo:501: 00000100:00100000:3.0:1790391295.523060:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.523081:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.523133:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186350208 00000100:00100000:1.0:1790391295.523138:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186350208 00000100:00100000:1.0:1790391295.523157:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790391295.523163:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186350208:12345-0@lo:501: 00000100:00100000:1.0:1790391295.523299:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186350208:12345-0@lo:501: Request processed in 135us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.523306:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790391295.523467:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350208:0@lo:501: 00000100:00100000:3.0:1790391295.523493:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350336:0@lo:503: 00000100:00100000:3.0:1790391295.523531:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.523559:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.523645:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186350336 00000100:00100000:1.0:1790391295.523655:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186350336 00000100:00100000:1.0:1790391295.523674:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790391295.523679:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186350336:12345-0@lo:503: 00000100:00100000:1.0:1790391295.525017:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186350336:12345-0@lo:503: Request processed in 1333us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.525028:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790391295.525123:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350336:0@lo:503: 00000100:00100000:1.0:1790391295.526122:0:9776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9776:1877361186350464:0@lo:502: 00000100:00100000:1.0:1790391295.526178:0:9776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.526256:0:9776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.526368:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186350464 00000100:00100000:0.0:1790391295.526383:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186350464 00000100:00100000:2.0:1790391295.526464:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790391295.526477:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9776:x1877361186350464:12345-0@lo:502: 00000100:00100000:2.0:1790391295.526608:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9776:x1877361186350464:12345-0@lo:502: Request processed in 135us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.526614:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790391295.526683:0:9776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9776:1877361186350464:0@lo:502: 00000020:01000000:1.0:1790391295.527010:0:9776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391295.527019:0:9776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391295.527021:0:9776:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790391295.527026:0:9776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790391295.527027:0:9776:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790391295.527046:0:9776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9776:1877361186350592:0@lo:502: 00000100:00100000:1.0:1790391295.527080:0:9776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.527310:0:9776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722600 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.527426:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186350592 00000100:00100000:3.0:1790391295.527431:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186350592 00000100:00100000:3.0:1790391295.527455:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790391295.527474:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9776:x1877361186350592:12345-0@lo:502: 00000100:00100000:3.0:1790391295.528202:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:9776:x1877361186350592:12345-0@lo:502: Request processed in 738us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.528210:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790391295.534394:0:9776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9776:1877361186350592:0@lo:502: 00000020:01000000:1.0:1790391295.534444:0:9776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391295.534454:0:9776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391295.534457:0:9776:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790391295.534463:0:9776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1790391295.534961:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790391295.535027:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790391295.535044:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.535079:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391295.535097:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790391295.535100:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52b5eaa800 from 39 10000000:01000000:1.0:1790391295.535103:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391295.535145:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.535161:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.535171:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391295.535197:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350720:0@lo:101: 00000100:00100000:1.0:1790391295.535301:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.535347:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722600 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.535607:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186350720 00000100:00100000:1.0:1790391295.535615:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186350720 00000100:00100000:1.0:1790391295.535682:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790391295.535891:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186350720:12345-0@lo:101: 00010000:00010000:1.0:1790391295.535906:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391295.535920:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0e99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.535944:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e92 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.535967:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e92 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.535976:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f6600, rc 0) 00000100:00100000:1.0:1790391295.536017:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186350720:12345-0@lo:101: Request processed in 325us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.536023:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790391295.536064:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350720:0@lo:101: 00010000:00010000:1.0:1790391295.536076:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.536085:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391295.536136:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350848:0@lo:501: 00000100:00100000:1.0:1790391295.536161:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.536176:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722600 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.536187:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186350848 00000100:00100000:1.0:1790391295.536191:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186350848 00000100:00100000:1.0:1790391295.536212:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790391295.536217:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186350848:12345-0@lo:501: 00000100:00100000:1.0:1790391295.537673:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186350848:12345-0@lo:501: Request processed in 1450us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.537682:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790391295.537942:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350848:0@lo:501: 00000100:00100000:1.0:1790391295.537991:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350976:0@lo:503: 00000100:00100000:1.0:1790391295.538038:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.538062:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.538076:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186350976 00000100:00100000:1.0:1790391295.538081:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186350976 00000100:00100000:1.0:1790391295.538107:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790391295.538115:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186350976:12345-0@lo:503: 00000100:00100000:1.0:1790391295.538193:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186350976:12345-0@lo:503: Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.538199:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790391295.538911:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186350976:0@lo:503: 00000100:00100000:0.0:1790391295.543643:0:9779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9779:1877361186351104:0@lo:502: 00000100:00100000:0.0:1790391295.543734:0:9779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.544037:0:9779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528763fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.544142:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186351104 00000100:00100000:1.0:1790391295.544150:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186351104 00000100:00100000:1.0:1790391295.544201:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790391295.544211:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:9779:x1877361186351104:12345-0@lo:502: 00000100:00100000:1.0:1790391295.544351:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:9779:x1877361186351104:12345-0@lo:502: Request processed in 142us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.544360:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790391295.544522:0:9779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9779:1877361186351104:0@lo:502: 00000100:00100000:2.0:1790391295.544583:0:9779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9779:1877361186351232:0@lo:502: 00000100:00100000:2.0:1790391295.544620:0:9779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.544644:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186351232 00000100:00100000:2.0:1790391295.544648:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186351232 00000100:00100000:2.0:1790391295.544670:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790391295.544676:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:9779:x1877361186351232:12345-0@lo:502: 00000100:00100000:2.0:1790391295.544758:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:9779:x1877361186351232:12345-0@lo:502: Request processed in 81us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.544776:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790391295.545020:0:9779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.545033:0:9779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9779:1877361186351232:0@lo:502: 00000040:00080000:2.0:1790391295.545053:0:9779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1790391295.545111:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1790391295.545143:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790391295.545153:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.545172:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391295.545182:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790391295.545184:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e52b5eaa800 from 6 10000000:01000000:2.0:1790391295.545188:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391295.545213:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.545231:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.545243:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391295.545254:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186351360:0@lo:101: 00000100:00100000:2.0:1790391295.545282:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.545307:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.545319:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186351360 00000100:00100000:2.0:1790391295.545323:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186351360 00000100:00100000:2.0:1790391295.545340:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790391295.545347:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186351360:12345-0@lo:101: 00010000:00010000:2.0:1790391295.545355:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391295.545366:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0ea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0ea0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.545397:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ea0 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.545417:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ea0 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.545425:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e529566d600, rc 0) 00000100:00100000:2.0:1790391295.545455:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186351360:12345-0@lo:101: Request processed in 109us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.545461:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790391295.545491:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186351360:0@lo:101: 00010000:00010000:2.0:1790391295.545502:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.545511:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391295.545565:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186351488:0@lo:256: 00000100:00100000:2.0:1790391295.545593:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.545606:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.545616:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186351488 00000100:00100000:2.0:1790391295.545620:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186351488 00000100:00100000:2.0:1790391295.545636:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790391295.545642:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186351488:12345-0@lo:256: 20000000:01000000:2.0:1790391295.545653:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790391295.545668:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790391295.545671:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1790391295.546079:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186351488:12345-0@lo:256: Request processed in 436us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.546086:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790391295.546121:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186351488:0@lo:256: 10000000:01000000:2.0:1790391295.546164:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790391295.546171:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.546178:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391295.546184:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1790391295.546186:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1790391295.546188:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790391295.546203:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.546210:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.546217:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391295.546240:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186351616:0@lo:101: 00000100:00100000:2.0:1790391295.546264:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.546277:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.546300:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186351616 00000100:00100000:2.0:1790391295.546303:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186351616 00000100:00100000:2.0:1790391295.546321:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790391295.546326:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186351616:12345-0@lo:101: 00010000:00010000:2.0:1790391295.546333:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391295.546342:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e529566da00/0x2b1b7949f13e0eb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0eae expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.546362:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e529566da00/0x2b1b7949f13e0eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0eae expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.546369:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e529566da00/0x2b1b7949f13e0eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0eae expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.546475:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e529566da00, rc 0) 00000100:00100000:2.0:1790391295.546507:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186351616:12345-0@lo:101: Request processed in 180us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.546512:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790391295.546600:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186351616:0@lo:101: 00010000:00010000:2.0:1790391295.546612:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.546620:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391295.546667:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186351744:0@lo:501: 00000100:00100000:2.0:1790391295.546692:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.546902:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.546913:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186351744 00000100:00100000:2.0:1790391295.546917:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186351744 00000100:00100000:2.0:1790391295.546933:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790391295.546938:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186351744:12345-0@lo:501: 00000100:00100000:2.0:1790391295.547026:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186351744:12345-0@lo:501: Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.547032:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790391295.547065:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186351744:0@lo:501: 00000100:00100000:2.0:1790391295.547087:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186351872:0@lo:503: 00000100:00100000:2.0:1790391295.547117:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.547128:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.547137:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186351872 00000100:00100000:2.0:1790391295.547140:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186351872 00000100:00100000:2.0:1790391295.547154:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790391295.547159:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186351872:12345-0@lo:503: 00000100:00100000:2.0:1790391295.547217:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186351872:12345-0@lo:503: Request processed in 58us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.547368:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790391295.547458:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186351872:0@lo:503: 00000100:00100000:0.0:1790391295.548592:0:9780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9780:1877361186352000:0@lo:502: 00000100:00100000:0.0:1790391295.548633:0:9780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.548661:0:9780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.548959:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186352000 00000100:00100000:1.0:1790391295.548965:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186352000 00000100:00100000:1.0:1790391295.548998:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790391295.549005:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:9780:x1877361186352000:12345-0@lo:502: 00000100:00100000:1.0:1790391295.549096:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:9780:x1877361186352000:12345-0@lo:502: Request processed in 91us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.549103:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790391295.549169:0:9780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9780:1877361186352000:0@lo:502: 00000020:01000000:0.0:1790391295.549190:0:9780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790391295.549196:0:9780:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790391295.549202:0:9780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391295.549204:0:9780:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790391295.549209:0:9780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790391295.549212:0:9780:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:0.0:1790391295.549243:0:9780:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790391295.549245:0:9780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391295.549257:0:9780:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e52b9aa8000) 00000020:00000080:0.0:1790391295.549276:0:9780:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1790391295.549281:0:9780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790391295.549364:0:9780:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1790391295.549370:0:9780:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790391295.549385:0:9780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e0ec3 00010000:00080000:0.0:1790391295.549413:0:9780:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5183332800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:0.0:1790391295.550007:0:9780:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1790391295.550119:0:9780:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1790391295.550129:0:9780:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1790391295.550347:0:9780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391295.550685:0:9780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391295.551067:0:9780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1790391295.551154:0:9780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1790391295.552633:0:9781:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391295.552640:0:9781:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790391295.555129:0:9780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790391295.555151:0:9780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790391295.555195:0:9780:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790391295.555221:0:9780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e0eca 00000100:00080000:1.0:1790391295.555641:0:9780:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391295.555647:0:9780:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e5183332800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391295.555683:0:9780:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e518229d180 x1877361186352128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391295.556338:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186352128:0@lo:8: 00000100:00100000:0.0:1790391295.556469:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790391295.557313:0:9780:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790391295.557405:0:9780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391295.557411:0:9780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391295.557414:0:9780:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790391295.557417:0:9780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391295.557421:0:9780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391295.557423:0:9780:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790391295.557426:0:9780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790391295.557428:0:9780:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790391295.557460:0:9780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9780:1877361186352256:0@lo:502: 00000100:00100000:1.0:1790391295.557510:0:9780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.557553:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186352256 00000100:00100000:1.0:1790391295.557559:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186352256 00000100:00100000:1.0:1790391295.557601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790391295.557611:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:9780:x1877361186352256:12345-0@lo:502: 00000100:00100000:1.0:1790391295.558018:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:9780:x1877361186352256:12345-0@lo:502: Request processed in 407us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.558026:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790391295.558067:0:9780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.558089:0:9780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9780:1877361186352256:0@lo:502: 00000020:01000000:1.0:1790391295.558112:0:9780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391295.558121:0:9780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391295.558123:0:9780:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790391295.558126:0:9780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1790391295.558180:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1790391295.558199:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790391295.558209:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.558220:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391295.558442:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790391295.558444:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5289da8000 from 39 10000000:01000000:1.0:1790391295.558447:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391295.558473:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.558482:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391295.558491:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391295.558504:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186352384:0@lo:101: 00000100:00100000:1.0:1790391295.558532:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.558611:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.559342:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186352128 00000100:00100000:1.0:1790391295.559349:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186352128 00000100:00100000:1.0:1790391295.559418:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391295.559425:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186352128:12345-0@lo:8: 00010000:00080000:1.0:1790391295.559453:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:1.0:1790391295.559490:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e0ed8 00002000:00100000:1.0:1790391295.559505:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e5182261800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1790391295.559509:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1790391295.559513:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1790391295.559937:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790391295.560147:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1790391295.560172:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9e5182265000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391295.563361:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1877361186352128:12345-0@lo:8: Request processed in 3924us (6882us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.563449:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1790391295.565354:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229d180 x1877361186352128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391295.565368:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391295.565388:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1790391295.565397:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790391295.565402:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790391295.565405:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183332800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790391295.565419:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790391295.565425:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186352128:0@lo:8: 00000100:00100000:0.0:1790391295.565466:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186352384 00000100:00100000:0.0:1790391295.565473:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186352384 00000100:00100000:0.0:1790391295.565526:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790391295.565534:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186352384:12345-0@lo:101: 00010000:00010000:0.0:1790391295.565552:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391295.565571:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e0edf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0ed1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.565598:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e0edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ed1 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.565615:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e0edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ed1 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.565624:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef200, rc 0) 00000100:00100000:0.0:1790391295.565690:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186352384:12345-0@lo:101: Request processed in 157us (7158us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.565696:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790391295.566037:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186352384:0@lo:101: 00010000:00010000:0.0:1790391295.566054:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.566064:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391295.566144:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186352512:0@lo:501: 00000100:00100000:0.0:1790391295.566177:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.566206:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.566220:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186352512 00000100:00100000:0.0:1790391295.566235:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186352512 00000100:00100000:0.0:1790391295.566259:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790391295.566265:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186352512:12345-0@lo:501: 00000100:00100000:0.0:1790391295.566439:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186352512:12345-0@lo:501: Request processed in 173us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.566446:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790391295.566474:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186352512:0@lo:501: 00000100:00100000:0.0:1790391295.566499:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186352640:0@lo:503: 00000100:00100000:0.0:1790391295.566647:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.566661:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.566673:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186352640 00000100:00100000:0.0:1790391295.566676:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186352640 00000100:00100000:0.0:1790391295.566697:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790391295.566899:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186352640:12345-0@lo:503: 00000100:00100000:0.0:1790391295.566977:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186352640:12345-0@lo:503: Request processed in 99us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.566984:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790391295.567022:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186352640:0@lo:503: 00000004:00080000:0.0:1790391295.567161:0:9781:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790391295.567223:0:9781:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 208934345455ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790391295.567231:0:9781:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1790391295.568598:0:9783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9783:1877361186352768:0@lo:502: 00000100:00100000:2.0:1790391295.568657:0:9783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.568691:0:9783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.569013:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186352768 00000100:00100000:0.0:1790391295.569019:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186352768 00000100:00100000:0.0:1790391295.569054:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790391295.569062:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:9783:x1877361186352768:12345-0@lo:502: 00000100:00100000:0.0:1790391295.569166:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:9783:x1877361186352768:12345-0@lo:502: Request processed in 104us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.569172:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790391295.569508:0:9783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9783:1877361186352768:0@lo:502: 00000100:00100000:2.0:1790391295.569566:0:9783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9783:1877361186352896:0@lo:502: 00000100:00100000:2.0:1790391295.569600:0:9783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.569611:0:9783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.569992:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186352896 00000100:00100000:0.0:1790391295.569997:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186352896 00000100:00100000:0.0:1790391295.570030:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790391295.570037:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:9783:x1877361186352896:12345-0@lo:502: 00000100:00100000:0.0:1790391295.570105:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:9783:x1877361186352896:12345-0@lo:502: Request processed in 69us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.570112:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790391295.570211:0:9783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9783:1877361186352896:0@lo:502: 00000040:00080000:2.0:1790391295.570232:0:9783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1790391295.570442:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1790391295.570463:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790391295.570472:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.570482:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391295.570491:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790391295.570494:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5289da8000 from 6 10000000:01000000:0.0:1790391295.570497:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790391295.570523:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.570531:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.570650:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391295.570665:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186353024:0@lo:101: 00000100:00100000:0.0:1790391295.570695:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.570920:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.571039:0:9782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9782:1877361186353152:0@lo:700: 00000100:00100000:1.0:1790391295.571073:0:9782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.571097:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186353152 00000100:00100000:1.0:1790391295.571101:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186353152 00000100:00100000:1.0:1790391295.571142:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391295.571148:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9782:x1877361186353152:12345-0@lo:700: 00000100:00100000:1.0:1790391295.571175:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1877361186353280:0@lo:700: 00000100:00100000:1.0:1790391295.571200:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.571218:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f93c0 going to sleep for 11 seconds 00000100:00080000:1.0:1790391295.571229:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391295.571244:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186353280 00000100:00100000:1.0:1790391295.571247:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186353280 00000100:00100000:1.0:1790391295.571271:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391295.571277:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1877361186353280:12345-0@lo:700: 00000100:00100000:2.0:1790391295.571469:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186353024 00000100:00100000:2.0:1790391295.571474:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186353024 00000100:00100000:2.0:1790391295.571499:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790391295.571507:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186353024:12345-0@lo:101: 00010000:00010000:2.0:1790391295.571525:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391295.571604:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e529566c600/0x2b1b7949f13e0eed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0ee6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.571627:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e529566c600/0x2b1b7949f13e0eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ee6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.571637:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e529566c600/0x2b1b7949f13e0eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ee6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.571646:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e529566c600, rc 0) 00000100:00100000:2.0:1790391295.571683:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186353024:12345-0@lo:101: Request processed in 176us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.571689:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790391295.571922:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186353024:0@lo:101: 00010000:00010000:2.0:1790391295.571935:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.571945:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391295.571990:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186353408:0@lo:256: 00000100:00100000:2.0:1790391295.572020:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.572034:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.572045:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186353408 00000100:00100000:2.0:1790391295.572049:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186353408 00000100:00100000:2.0:1790391295.572071:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790391295.572077:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186353408:12345-0@lo:256: 20000000:01000000:2.0:1790391295.572097:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790391295.572112:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790391295.572114:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1790391295.572181:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186353408:12345-0@lo:256: Request processed in 104us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.572187:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790391295.572215:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186353408:0@lo:256: 10000000:01000000:2.0:1790391295.572255:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790391295.572261:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.572270:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391295.572277:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790391295.572279:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1790391295.572281:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790391295.572325:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.572333:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.572341:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391295.572353:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186353536:0@lo:101: 00000100:00100000:1.0:1790391295.572474:0:9782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9240 going to sleep for 11 seconds 00000004:00080000:0.0:1790391295.573595:0:7444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1790391295.574094:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.574139:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.575358:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186353536 00000100:00100000:0.0:1790391295.575369:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186353536 00000100:00100000:0.0:1790391295.575436:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790391295.575445:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186353536:12345-0@lo:101: 00010000:00010000:0.0:1790391295.575460:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391295.575478:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e0efb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0ef4 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.575511:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e0efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ef4 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.575522:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e0efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ef4 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.575531:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee600, rc 0) 00000100:00100000:0.0:1790391295.579972:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186353536:12345-0@lo:101: Request processed in 4518us (5869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.579985:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790391295.580198:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186353536:0@lo:101: 00010000:00010000:2.0:1790391295.580225:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391295.580239:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391295.580328:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186353664:0@lo:501: 00000100:00100000:2.0:1790391295.581480:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.581520:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.581896:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186353664 00000100:00100000:2.0:1790391295.581903:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186353664 00000100:00100000:2.0:1790391295.581950:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790391295.581959:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186353664:12345-0@lo:501: 00000100:00100000:2.0:1790391295.582087:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186353664:12345-0@lo:501: Request processed in 129us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.582094:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790391295.582136:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186353664:0@lo:501: 00000100:00100000:2.0:1790391295.582175:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186353792:0@lo:503: 00000100:00100000:2.0:1790391295.582217:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.582232:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528763f000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.582245:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186353792 00000100:00100000:2.0:1790391295.582248:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186353792 00000100:00100000:2.0:1790391295.582269:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790391295.582275:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186353792:12345-0@lo:503: 00000100:00100000:2.0:1790391295.582358:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186353792:12345-0@lo:503: Request processed in 82us (139us total) trans 0 rc 0/0 40000000:02000000:0.0:1790391295.582366:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1790391295.582372:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790391295.583969:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186353792:0@lo:503: 00000100:00100000:3.0:1790391295.585995:0:9787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9787:1877361186353920:0@lo:502: 00000100:00100000:3.0:1790391295.586068:0:9787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.586109:0:9787:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.586478:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186353920 00000100:00100000:2.0:1790391295.586486:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186353920 00000100:00100000:2.0:1790391295.586589:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790391295.586601:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:9787:x1877361186353920:12345-0@lo:502: 00000100:00100000:2.0:1790391295.587511:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:9787:x1877361186353920:12345-0@lo:502: Request processed in 909us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.587521:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790391295.589009:0:9787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9787:1877361186353920:0@lo:502: 00000020:01000000:2.0:1790391295.589045:0:9787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790391295.589053:0:9787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790391295.589061:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391295.589063:0:9787:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790391295.589068:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790391295.589071:0:9787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:2.0:1790391295.589097:0:9787:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790391295.589100:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391295.589125:0:9787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e5183384d40) 00000020:00000080:2.0:1790391295.589149:0:9787:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1790391295.589156:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790391295.589239:0:9787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790391295.589246:0:9787:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1790391295.589253:0:9787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e0f09 00010000:00080000:2.0:1790391295.589280:0:9787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5182f5f000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391295.589529:0:9787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1790391295.589670:0:9787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790391295.589687:0:9787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790391295.590102:0:9787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391295.590197:0:9787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391295.590335:0:9787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790391295.590425:0:9787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:0.0:1790391295.593869:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1877361186353280:12345-0@lo:700: Request processed in 22584us (22660us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.593912:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790391295.594912:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229d180 x1877361186353280/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790391311 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.594940:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1877361186353280:0@lo:700: 40000000:02000000:1.0:1790391295.594955:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:3.0:1790391295.604050:0:9789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790391295.604059:0:9789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790391295.609508:0:9787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790391295.609523:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790391295.609672:0:9787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790391295.609708:0:9787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e0f10 00000100:00080000:0.0:1790391295.609719:0:9787:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391295.609725:0:9787:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5182f5f000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391295.609759:0:9787:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51822a6680 x1877361186354048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391295.609958:0:9787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790391295.610009:0:9787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391295.610014:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391295.610016:0:9787:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790391295.610019:0:9787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391295.610030:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391295.610031:0:9787:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790391295.610036:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790391295.610037:0:9787:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790391295.610065:0:9787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9787:1877361186354176:0@lo:502: 00000100:00100000:3.0:1790391295.611066:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186354048:0@lo:8: 00000100:00100000:3.0:1790391295.611157:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.611217:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186354048 00000100:00100000:3.0:1790391295.611225:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186354048 00000100:00100000:3.0:1790391295.611258:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391295.611266:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186354048:12345-0@lo:8: 00010000:00080000:3.0:1790391295.611305:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1790391295.611332:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e0f17 00002000:00100000:3.0:1790391295.611345:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e52b9930000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790391295.611350:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790391295.611353:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790391295.611473:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790391295.611496:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9e52b9933800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391295.611610:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1877361186354048:12345-0@lo:8: Request processed in 343us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.611617:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1790391295.611661:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822a6680 x1877361186354048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391295.612073:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790391295.612083:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790391295.612090:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790391295.612095:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790391295.612098:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790391295.612107:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790391295.612112:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186354048:0@lo:8: 00000004:00080000:3.0:1790391295.612134:0:9789:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790391295.612188:0:9789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 208979309570ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790391295.612194:0:9789:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1790391295.613529:0:9787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.613581:0:9787:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.613929:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186354176 00000100:00100000:3.0:1790391295.613937:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186354176 00000100:00100000:3.0:1790391295.613979:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790391295.613988:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:9787:x1877361186354176:12345-0@lo:502: 00000100:00100000:3.0:1790391295.614109:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:9787:x1877361186354176:12345-0@lo:502: Request processed in 121us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.614116:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790391295.617167:0:9787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:9787:1877361186354176:0@lo:502: 00000020:01000000:0.0:1790391295.617209:0:9787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391295.617217:0:9787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391295.617219:0:9787:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790391295.617225:0:9787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1790391295.617498:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1790391295.617519:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790391295.617530:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.617548:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391295.617557:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790391295.617560:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e52ae8c99c0 from 1 10000000:01000000:3.0:1790391295.617563:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790391295.617597:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.617606:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.617616:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391295.617635:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186354304:0@lo:101: 00000100:00100000:3.0:1790391295.617696:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.617739:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.618076:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186354304 00000100:00100000:3.0:1790391295.618083:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186354304 00000100:00100000:3.0:1790391295.618133:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790391295.618143:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186354304:12345-0@lo:101: 00010000:00010000:3.0:1790391295.618154:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391295.618168:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e0f25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0f1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.618190:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e0f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0f1e expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.618200:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e0f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0f1e expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.618209:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031400, rc 0) 00000100:00100000:3.0:1790391295.618247:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186354304:12345-0@lo:101: Request processed in 106us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.618253:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790391295.618302:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186354304:0@lo:101: 00010000:00010000:3.0:1790391295.618315:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391295.618324:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391295.618496:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186354432:0@lo:501: 00000100:00100000:3.0:1790391295.618523:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391295.618556:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.618595:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186354432 00000100:00100000:0.0:1790391295.618599:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186354432 00000100:00100000:0.0:1790391295.618627:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790391295.618633:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186354432:12345-0@lo:501: 00000100:00100000:0.0:1790391295.618718:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186354432:12345-0@lo:501: Request processed in 85us (195us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391295.618725:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790391295.618755:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186354432:0@lo:501: 10000000:01000000:0.0:1790391295.618786:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790391295.618792:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391295.618811:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1790391295.624922:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1790391295.624933:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1790391295.625055:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9782:x1877361186353152:12345-0@lo:700: Request processed in 53902us (53976us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.625074:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790391295.625942:0:9782:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229ce00 x1877361186353152/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790391311 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.625958:0:9782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9782:1877361186353152:0@lo:700: 00000004:00080000:1.0:1790391295.627822:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1790391295.633004:0:9792:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790391295.633025:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186354560:0@lo:13: 00000100:00100000:1.0:1790391295.633028:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9792:1877361186354688:0@lo:7: 00000100:00100000:1.0:1790391295.633304:0:9792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.633340:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9240 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.633395:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186354688 00000100:00100000:0.0:1790391295.633408:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186354688 00000100:00100000:0.0:1790391295.633470:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391295.633481:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9792:x1877361186354688:12345-0@lo:7: 00000100:00080000:1.0:1790391295.633710:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391295.636938:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1790391295.636962:0:9782:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790391295.636985:0:9782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9782:1877361186354944:0@lo:7: 00000100:00100000:2.0:1790391295.636988:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391295.636992:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186354816:0@lo:13: 00000100:00100000:2.0:1790391295.637906:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.637948:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186354560 00000100:00100000:2.0:1790391295.637955:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186354560 00000100:00100000:2.0:1790391295.637991:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186354816 00000100:00100000:2.0:1790391295.637994:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186354816 00000100:00100000:2.0:1790391295.638008:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391295.638016:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186354560:12345-0@lo:13: 00002000:00000024:2.0:1790391295.638042:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923849216 avail 3692326912 00000100:00100000:2.0:1790391295.638090:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186354560:12345-0@lo:13: Request processed in 74us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.638098:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391295.638113:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391295.638120:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186354816:12345-0@lo:13: 00002000:00000024:2.0:1790391295.638129:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923849216 avail 3692326912 00000100:00100000:2.0:1790391295.638154:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186354816:12345-0@lo:13: Request processed in 35us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.638160:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1790391295.638196:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229f100 x1877361186354816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391295.638215:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186354816:0@lo:13: 00010000:00080000:2.0:1790391295.638236:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229ce00 x1877361186354560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391295.638248:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186354560:0@lo:13: 00000100:00100000:1.0:1790391295.639744:0:9782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.639789:0:9782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391295.640477:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790391295.640486:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1790391295.641366:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1790391295.641372:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790391295.641469:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9792:x1877361186354688:12345-0@lo:7: Request processed in 7987us (8162us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.641480:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790391295.641534:0:9792:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229d180 x1877361186354688/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790391311 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391295.641804:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9792:1877361186354688:0@lo:7: 00000004:00080000:0.0:1790391295.641820:0:9792:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790391295.641858:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9792:1877361186355072:0@lo:5: 00000100:00100000:0.0:1790391295.641913:0:9792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.641935:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391295.641951:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186354944 00000100:00100000:0.0:1790391295.641957:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186354944 00000100:00100000:0.0:1790391295.641985:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186355072 00000100:00100000:0.0:1790391295.641988:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186355072 00000100:00100000:0.0:1790391295.642003:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391295.642011:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9782:x1877361186354944:12345-0@lo:7: 00002000:00080000:0.0:1790391295.651100:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1790391295.651111:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790391295.651207:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9782:x1877361186354944:12345-0@lo:7: Request processed in 9191us (11462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391295.651219:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391295.651253:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391295.651263:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9792:x1877361186355072:12345-0@lo:5: 00002000:00080000:0.0:1790391295.651308:0:8427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1790391295.651312:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:1.0:1790391295.651662:0:9782:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229df80 x1877361186354944/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790391311 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.651678:0:9782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9782:1877361186354944:0@lo:7: 00000004:00080000:1.0:1790391295.651693:0:9782:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790391295.651728:0:9782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9782:1877361186355200:0@lo:5: 00000100:00100000:1.0:1790391295.651763:0:9782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.651797:0:9782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.651917:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186355200 00000100:00100000:3.0:1790391295.651924:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186355200 00000100:00100000:3.0:1790391295.651960:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391295.651968:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9782:x1877361186355200:12345-0@lo:5: 00002000:00080000:3.0:1790391295.651981:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1790391295.652016:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9782:x1877361186355200:12345-0@lo:5: Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391295.652022:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1790391295.652726:0:9782:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229df80 x1877361186355200/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391311 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.652738:0:9782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9782:1877361186355200:0@lo:5: 00000004:00080000:1.0:1790391295.652749:0:9782:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790391295.652777:0:9782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9782:1877361186355328:0@lo:5: 00000100:00100000:1.0:1790391295.652807:0:9782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.652831:0:9782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.652933:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186355328 00000100:00100000:3.0:1790391295.652939:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186355328 00000100:00100000:3.0:1790391295.652966:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391295.652973:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9782:x1877361186355328:12345-0@lo:5: 00002000:00080000:3.0:1790391295.652996:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1790391295.653521:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9792:x1877361186355072:12345-0@lo:5: Request processed in 2259us (11606us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790391295.653529:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1790391295.653630:0:9792:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822a4700 x1877361186355072/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391311 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.653643:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9792:1877361186355072:0@lo:5: 00000004:00080000:1.0:1790391295.653651:0:9792:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790391295.653672:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9792:1877361186355456:0@lo:700: 00000100:00100000:1.0:1790391295.653697:0:9792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391295.653713:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391295.653727:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186355456 00000100:00100000:1.0:1790391295.653731:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186355456 00000100:00100000:1.0:1790391295.653760:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391295.653767:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:9792:x1877361186355456:12345-0@lo:700: 00000100:00100000:3.0:1790391295.657778:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9782:x1877361186355328:12345-0@lo:5: Request processed in 4800us (4965us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790391295.657791:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790391295.658474:0:9782:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229df80 x1877361186355328/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391311 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391295.658492:0:9782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9782:1877361186355328:0@lo:5: 00000004:00080000:2.0:1790391295.658508:0:9782:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1790391295.658599:0:9782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9782:1877361186355584:0@lo:900: 00000100:00100000:2.0:1790391295.658639:0:9782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391295.658713:0:9782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282d270c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.661986:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186355584 00000100:00100000:3.0:1790391295.661998:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186355584 00000100:00100000:2.0:1790391295.665164:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391295.665177:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9782:x1877361186355584:12345-0@lo:900: 00000100:00100000:2.0:1790391295.665279:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9782:x1877361186355584:12345-0@lo:900: Request processed in 104us (6638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391295.665296:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790391295.665341:0:9782:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e529233a300 x1877361186355584/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790391311 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391295.665356:0:9782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9782:1877361186355584:0@lo:900: 00000001:00080000:3.0:1790391295.672531:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1790391295.672556:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1790391295.672704:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9792:x1877361186355456:12345-0@lo:700: Request processed in 18933us (19001us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391295.672717:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790391295.672946:0:9792:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229d180 x1877361186355456/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790391311 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391295.672957:0:9792:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790391295.672973:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9792:1877361186355456:0@lo:700: 00000004:02000040:0.0:1790391295.675292:0:9792:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1790391295.684435:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9792:1877361186355712:0@lo:5: 00000100:00100000:0.0:1790391295.684505:0:9792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391295.684601:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b5f9a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391295.685139:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186355712 00000100:00100000:3.0:1790391295.685147:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186355712 00000100:00100000:3.0:1790391295.685195:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391295.685204:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9792:x1877361186355712:12345-0@lo:5: 00002000:00080000:3.0:1790391295.696662:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1790391295.696685:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1790391295.704047:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9792:x1877361186355712:12345-0@lo:5: Request processed in 18837us (19535us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790391295.704066:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1790391295.706344:0:9792:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822a4700 x1877361186355712/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391311 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391295.706366:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9792:1877361186355712:0@lo:5: 00000004:00080000:1.0:1790391295.706600:0:9792:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1790391295.943953:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391296.970674:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391297.033683:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391297.033712:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186355840:0@lo:13: 00000100:00100000:3.0:1790391297.033780:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391297.034248:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391297.034259:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186356096:0@lo:13: 00000100:00100000:1.0:1790391297.034301:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391297.034344:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186355968:0@lo:41: 00000100:00100000:3.0:1790391297.034369:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391297.034396:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186355968 00000100:00100000:1.0:1790391297.034403:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186355968 00000100:00100000:1.0:1790391297.034449:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790391297.034458:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186355968:12345-0@lo:41: 00000004:00000024:1.0:1790391297.034488:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790391297.034540:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186355968:12345-0@lo:41: Request processed in 82us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391297.034547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790391297.034588:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186355968:0@lo:41: 00000100:00100000:2.0:1790391297.036010:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186355840 00000100:00100000:2.0:1790391297.036020:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186355840 00000100:00100000:2.0:1790391297.036081:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186356096 00000100:00100000:2.0:1790391297.036085:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186356096 00000100:00080000:3.0:1790391297.036090:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391297.036105:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391297.036113:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186355840:12345-0@lo:13: 00002000:00000024:2.0:1790391297.036143:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391297.036203:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186355840:12345-0@lo:13: Request processed in 91us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391297.036211:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391297.036225:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790391297.036232:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186356096:12345-0@lo:13: 00002000:00000024:2.0:1790391297.036241:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391297.036280:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186356096:12345-0@lo:13: Request processed in 40us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391297.036286:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790391297.036300:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831ddf80 x1877361186355840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391297.036316:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186355840:0@lo:13: 00010000:00080000:2.0:1790391297.036320:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229d180 x1877361186356096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391297.036331:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186356096:0@lo:13: 00000001:02000400:1.0:1790391297.533512:0:9876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790391297.992057:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790391298.474722:0:9928:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391298.475293:0:9928:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790391299.018565:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391299.082167:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186356224:0@lo:41: 00000100:00100000:2.0:1790391299.082244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391299.082363:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186356224 00000100:00100000:1.0:1790391299.082371:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186356224 00000100:00100000:1.0:1790391299.082428:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790391299.082448:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186356224:12345-0@lo:41: 00000004:00000024:1.0:1790391299.082485:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1790391299.082534:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186356224:12345-0@lo:41: Request processed in 88us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391299.082541:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391299.084004:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186356224:0@lo:41: 00000001:00080000:0.0:1790391299.407991:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1790391300.040433:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391300.616582:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186356608:0@lo:400: 00000100:00100000:1.0:1790391300.616653:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391300.616708:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186357120:0@lo:400: 00000100:00100000:1.0:1790391300.616733:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391300.616771:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186357632:0@lo:400: 00000100:00100000:1.0:1790391300.616794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391300.616824:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790391300.616830:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186356736:0@lo:400: 00000100:00100000:1.0:1790391300.616851:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391300.616869:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186357248:0@lo:400: 00000100:00100000:1.0:1790391300.616917:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391300.616938:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186357760:0@lo:400: 00000100:00100000:1.0:1790391300.616958:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391300.616994:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186356608 00000100:00100000:1.0:1790391300.617001:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186356608 00000100:00100000:1.0:1790391300.617045:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790391300.617055:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186356608:12345-0@lo:400: 00000100:00100000:0.0:1790391300.617301:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186356480:0@lo:400: 00000100:00100000:2.0:1790391300.617358:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186356352:0@lo:400: 00000100:00100000:0.0:1790391300.621435:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391300.621476:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186356992:0@lo:400: 00000100:00100000:0.0:1790391300.621506:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391300.621518:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186357504:0@lo:400: 00000100:00100000:0.0:1790391300.621535:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391300.621580:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186357248 00000100:00100000:0.0:1790391300.621588:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186357248 00000100:00100000:0.0:1790391300.621651:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186357760 00000100:00100000:0.0:1790391300.621655:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186357760 00000100:00100000:0.0:1790391300.621696:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391300.621705:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186357248:12345-0@lo:400: 00000100:00100000:3.0:1790391300.623399:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391300.623418:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186357760:12345-0@lo:400: 00000100:00100000:3.0:1790391300.623503:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186357760:12345-0@lo:400: Request processed in 93us (6544us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391300.623510:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391300.623960:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391300.624004:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186356864:0@lo:400: 00000100:00100000:2.0:1790391300.624032:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391300.624053:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186356864 00000100:00100000:2.0:1790391300.624060:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186356864 00000100:00100000:2.0:1790391300.624091:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391300.624108:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186356864:12345-0@lo:400: 00000100:00100000:2.0:1790391300.624145:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186356864:12345-0@lo:400: Request processed in 37us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391300.624164:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790391300.625269:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186357248:12345-0@lo:400: Request processed in 3559us (8345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391300.625279:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1790391300.625749:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391300.625762:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391300.625780:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186356352 00000100:00100000:0.0:1790391300.625788:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186356352 00000100:00100000:0.0:1790391300.625845:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790391300.625853:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186356352:12345-0@lo:400: 00000100:00100000:0.0:1790391300.625921:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186356352:12345-0@lo:400: Request processed in 68us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391300.625928:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790391300.626549:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186356864:0@lo:400: 00000100:00100000:2.0:1790391300.626561:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186357376:0@lo:400: 00000100:00100000:2.0:1790391300.626598:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391300.626635:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186357888:0@lo:400: 00000100:00100000:2.0:1790391300.626656:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391300.626679:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186357376 00000100:00100000:2.0:1790391300.626683:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186357376 00000100:00100000:2.0:1790391300.626721:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186357888 00000100:00100000:2.0:1790391300.626724:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186357888 00000100:00100000:2.0:1790391300.626750:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391300.626764:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186357376:12345-0@lo:400: 00000100:00100000:2.0:1790391300.626801:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186357376:12345-0@lo:400: Request processed in 44us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391300.626806:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391300.626831:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391300.626837:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186357888:12345-0@lo:400: 00000100:00100000:2.0:1790391300.626863:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186357888:12345-0@lo:400: Request processed in 27us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391300.626868:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1790391300.626901:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391300.626903:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790391300.626920:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183815180 x1877361186357888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391300.626930:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1790391300.626942:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186357888:0@lo:400: 00000100:00100000:2.0:1790391300.626980:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186356352:0@lo:400: 00010000:00080000:2.0:1790391300.626988:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a5c00 x1877361186357376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391300.626997:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186357376:0@lo:400: 00000100:00100000:2.0:1790391300.628460:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186357120 00000100:00100000:2.0:1790391300.628472:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186357120 00000100:00100000:2.0:1790391300.628520:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186357632 00000100:00100000:2.0:1790391300.628523:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186357632 00000100:00100000:2.0:1790391300.628537:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186356736 00000100:00100000:2.0:1790391300.628540:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186356736 00000100:00100000:2.0:1790391300.628550:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186356480 00000100:00100000:2.0:1790391300.628553:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186356480 00000100:00100000:2.0:1790391300.628563:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186356992 00000100:00100000:2.0:1790391300.628566:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186356992 00000100:00100000:2.0:1790391300.628576:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186357504 00000100:00100000:2.0:1790391300.628579:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186357504 00000100:00100000:2.0:1790391300.628594:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790391300.628602:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186357120:12345-0@lo:400: 00000100:00100000:2.0:1790391300.628664:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186357120:12345-0@lo:400: Request processed in 62us (11929us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391300.628670:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790391300.628684:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391300.628691:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186357632:12345-0@lo:400: 00000100:00100000:2.0:1790391300.629965:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186357632:12345-0@lo:400: Request processed in 52us (11947us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391300.629977:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391300.630000:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391300.630011:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186356736:12345-0@lo:400: 00000100:00100000:2.0:1790391300.630070:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186356736:12345-0@lo:400: Request processed in 62us (13217us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391300.630076:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391300.630088:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391300.630151:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186356480:12345-0@lo:400: 00000100:00100000:2.0:1790391300.630274:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186356480:12345-0@lo:400: Request processed in 178us (8845us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391300.630280:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391300.630905:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391300.630916:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186356992:12345-0@lo:400: 00000100:00100000:2.0:1790391300.630959:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186356992:12345-0@lo:400: Request processed in 46us (9451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391300.630964:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391300.630977:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391300.630984:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186357504:12345-0@lo:400: 00000100:00100000:2.0:1790391300.631012:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186357504:12345-0@lo:400: Request processed in 29us (9476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391300.631018:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1790391300.631073:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518206ed80 x1877361186356480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391300.631088:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186356480:0@lo:400: 00000100:00080000:3.0:1790391300.631443:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391300.631448:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790391300.631503:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a5180 x1877361186356992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391300.631514:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186356992:0@lo:400: 00010000:00080000:2.0:1790391300.631542:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a7b80 x1877361186357504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391300.631550:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186357504:0@lo:400: 00000100:00100000:1.0:1790391300.632994:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186356608:12345-0@lo:400: Request processed in 15935us (16335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391300.633007:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1790391300.634416:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a6a00 x1877361186356736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391300.634431:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186356736:0@lo:400: 00010000:00080000:1.0:1790391300.634445:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a4e00 x1877361186357248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391300.634452:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186357248:0@lo:400: 00010000:00080000:1.0:1790391300.634464:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183817b80 x1877361186357760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391300.634472:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790391300.634503:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186357760:0@lo:400: 00000100:00100000:1.0:1790391300.634518:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186356608:0@lo:400: 00010000:00080000:1.0:1790391300.634529:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a6d80 x1877361186357120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391300.634537:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186357120:0@lo:400: 00010000:00080000:1.0:1790391300.634548:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183817800 x1877361186357632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391300.634554:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186357632:0@lo:400: 00010000:00010000:1.0:1790391301.067608:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391301.144102:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186358016:0@lo:13: 00000100:00100000:1.0:1790391301.144165:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391301.144246:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186358016 00000100:00100000:1.0:1790391301.144254:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186358016 00000100:00100000:1.0:1790391301.144298:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391301.144306:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186358016:12345-0@lo:13: 00002000:00000024:1.0:1790391301.144333:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391301.144374:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186358016:12345-0@lo:13: Request processed in 68us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391301.144380:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1790391301.144420:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183817800 x1877361186358016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391301.144438:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186358016:0@lo:13: 00000100:00100000:2.0:1790391301.144758:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391301.144768:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186358144:0@lo:13: 00000100:00100000:2.0:1790391301.144802:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391301.144926:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186358144 00000100:00100000:0.0:1790391301.144930:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186358144 00000100:00100000:0.0:1790391301.144957:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391301.144964:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186358144:12345-0@lo:13: 00002000:00000024:0.0:1790391301.144974:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391301.145011:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186358144:12345-0@lo:13: Request processed in 47us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391301.145017:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790391301.145041:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822a4700 x1877361186358144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391301.145054:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186358144:0@lo:13: 00000020:00000004:1.0:1790391301.886648:0:10030:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391301.888693:0:10030:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790391302.089089:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391302.159872:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186358272:0@lo:13: 00000100:00100000:2.0:1790391302.159965:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391302.160036:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186358272 00000100:00100000:2.0:1790391302.160044:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186358272 00000100:00100000:2.0:1790391302.160097:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391302.160109:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186358272:12345-0@lo:13: 00002000:00000024:2.0:1790391302.160139:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391302.160183:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186358272:12345-0@lo:13: Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391302.160190:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1790391302.160211:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790391302.160251:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518206f100 x1877361186358272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391302.160269:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186358272:0@lo:13: 00000100:00100000:1.0:1790391302.174168:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186358400:0@lo:13: 00000100:00100000:1.0:1790391302.174252:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391302.174310:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391302.174318:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186358528:0@lo:41: 00000100:00100000:1.0:1790391302.174350:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391302.175484:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186358528 00000100:00100000:2.0:1790391302.175496:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186358528 00000100:00100000:2.0:1790391302.175549:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391302.175558:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186358528:12345-0@lo:41: 00000004:00000024:2.0:1790391302.175600:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790391302.175668:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186358528:12345-0@lo:41: Request processed in 111us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391302.175687:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391302.182663:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186358528:0@lo:41: 00000100:00100000:2.0:1790391302.182921:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186358400 00000100:00100000:2.0:1790391302.182928:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186358400 00000100:00100000:2.0:1790391302.182996:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790391302.183006:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186358400:12345-0@lo:13: 00002000:00000024:2.0:1790391302.183029:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391302.183109:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186358400:12345-0@lo:13: Request processed in 104us (8857us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391302.183117:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790391302.183157:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831ddf80 x1877361186358400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391302.183173:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186358400:0@lo:13: 00000100:00080000:1.0:1790391302.200852:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391303.118591:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790391303.211340:0:10078:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391303.211351:0:10078:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1790391303.849626:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391303.849938:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169531008 00000100:00100000:2.0:1790391303.849948:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169531008 00000100:00100000:2.0:1790391303.849986:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 180 00000100:00100000:2.0:1790391303.849993:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2380:x1877361169531008:12345-192.168.202.28@tcp:250: 00010000:00080000:2.0:1790391303.850022:0:6507:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 70c6dba3-950e-4d6c-8a57-84db940a8db9@192.168.202.28@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1790391303.850051:0:6507:0:(genops.c:1385:class_connect()) connect: client 70c6dba3-950e-4d6c-8a57-84db940a8db9, cookie 0x2b1b7949f13e0f2c 00000100:00080000:2.0:1790391303.850182:0:6507:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391303.850284:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+5:2380:x1877361169531008:12345-192.168.202.28@tcp:250: Request processed in 290us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391303.850292:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 180 00000100:00100000:2.0:1790391303.868842:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391303.869083:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169531136 00000100:00100000:0.0:1790391303.869105:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169531136 00000100:00100000:0.0:1790391303.869165:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 181 00000100:00100000:0.0:1790391303.869176:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+5:6144:x1877361169531136:12345-192.168.202.28@tcp:101: 00010000:00010000:0.0:1790391303.869193:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391303.869230:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eefe00/0x2b1b7949f13e0f33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49affa9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.869259:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eefe00/0x2b1b7949f13e0f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affa9 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.869271:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eefe00/0x2b1b7949f13e0f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affa9 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391303.869282:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefe00, rc 0) 00000100:00100000:0.0:1790391303.869345:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+6:6144:x1877361169531136:12345-192.168.202.28@tcp:101: Request processed in 170us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391303.869353:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 181 00000100:00100000:3.0:1790391303.877970:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391303.878201:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169531264 00000100:00100000:0.0:1790391303.878252:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169531264 00000100:00100000:0.0:1790391303.879574:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 182 00000100:00100000:0.0:1790391303.879591:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+6:6144:x1877361169531264:12345-192.168.202.28@tcp:501: 00000100:00100000:0.0:1790391303.879721:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+6:6144:x1877361169531264:12345-192.168.202.28@tcp:501: Request processed in 135us (1760us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391303.879730:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 182 00000100:00100000:3.0:1790391303.882344:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391303.886911:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169531392 00000100:00100000:2.0:1790391303.886929:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169531392 00000100:00100000:2.0:1790391303.887052:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 183 00000100:00100000:2.0:1790391303.887065:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+6:6144:x1877361169531392:12345-192.168.202.28@tcp:101: 00010000:00010000:2.0:1790391303.887085:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391303.887105:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e0f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49affb0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.887149:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e0f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affb0 expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.887162:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e0f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affb0 expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391303.887171:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e529566c400, rc 0) 00000100:00100000:2.0:1790391303.887250:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+7:6144:x1877361169531392:12345-192.168.202.28@tcp:101: Request processed in 187us (4913us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391303.887257:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 183 00000100:00100000:1.0:1790391303.896950:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391303.904324:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169531520 00000100:00100000:0.0:1790391303.904341:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169531520 00000100:00100000:0.0:1790391303.904413:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 184 00000100:00100000:0.0:1790391303.904424:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+7:6144:x1877361169531520:12345-192.168.202.28@tcp:501: 00000100:00100000:0.0:1790391303.904630:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:6144:x1877361169531520:12345-192.168.202.28@tcp:501: Request processed in 207us (7690us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391303.904638:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 184 00000100:00100000:0.0:1790391303.906860:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391303.907042:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169531648 00000100:00100000:2.0:1790391303.907053:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169531648 00000100:00100000:2.0:1790391303.907099:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 185 00000100:00100000:2.0:1790391303.907108:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:6144:x1877361169531648:12345-192.168.202.28@tcp:503: 00000100:00100000:2.0:1790391303.907260:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:6144:x1877361169531648:12345-192.168.202.28@tcp:503: Request processed in 152us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391303.907267:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 185 00000100:00100000:1.0:1790391303.915625:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391303.915723:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169531776 00000100:00100000:2.0:1790391303.915733:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169531776 00000100:00100000:2.0:1790391303.915803:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 186 00000100:00100000:2.0:1790391303.915814:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:6163:x1877361169531776:12345-192.168.202.28@tcp:502: 00000100:00100000:2.0:1790391303.915982:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:6163:x1877361169531776:12345-192.168.202.28@tcp:502: Request processed in 169us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391303.915991:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 186 00000100:00100000:0.0:1790391303.977736:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391303.977915:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169531904 00000100:00100000:3.0:1790391303.977939:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169531904 00000100:00100000:3.0:1790391303.977999:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 187 00000100:00100000:3.0:1790391303.978009:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:6163:x1877361169531904:12345-192.168.202.28@tcp:502: 00000100:00100000:3.0:1790391303.978171:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:6163:x1877361169531904:12345-192.168.202.28@tcp:502: Request processed in 163us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391303.978179:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 187 00000100:00100000:3.0:1790391303.984754:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391303.987052:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169532032 00000100:00100000:1.0:1790391303.987066:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169532032 00000100:00100000:1.0:1790391303.987157:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 188 00000100:00100000:1.0:1790391303.987169:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:6144:x1877361169532032:12345-192.168.202.28@tcp:101: 00010000:00010000:1.0:1790391303.987187:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391303.987218:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f6800/0x2b1b7949f13e0f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49affe1 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.987249:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f6800/0x2b1b7949f13e0f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe1 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.987260:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f6800/0x2b1b7949f13e0f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe1 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391303.987279:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f6800, rc 0) 00000100:00100000:1.0:1790391303.987360:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6144:x1877361169532032:12345-192.168.202.28@tcp:101: Request processed in 187us (2607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391303.987367:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 188 00000100:00100000:1.0:1790391303.995332:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391303.995436:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169532160 00000100:00100000:2.0:1790391303.995446:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169532160 00000100:00100000:2.0:1790391303.995510:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 189 00000100:00100000:2.0:1790391303.995521:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6144:x1877361169532160:12345-192.168.202.28@tcp:256: 20000000:01000000:2.0:1790391303.995546:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790391303.995571:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790391303.995576:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790391303.995579:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790391303.995582:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790391303.995584:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1790391304.010379:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6144:x1877361169532160:12345-192.168.202.28@tcp:256: Request processed in 14845us (15041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391304.010394:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 189 00000100:00100000:3.0:1790391304.023378:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391304.023593:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169532288 00000100:00100000:2.0:1790391304.023602:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169532288 00000100:00100000:2.0:1790391304.023669:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 190 00000100:00100000:2.0:1790391304.023681:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6144:x1877361169532288:12345-192.168.202.28@tcp:101: 00010000:00010000:2.0:1790391304.024077:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391304.024155:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0f48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49affe8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391304.024188:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe8 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391304.024199:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe8 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391304.024219:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280030600, rc 0) 00000100:00100000:3.0:1790391304.024278:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6144:x1877361169532288:12345-192.168.202.28@tcp:101: Request processed in 598us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391304.024285:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 190 00000100:00100000:1.0:1790391304.029918:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391304.030612:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169532416 00000100:00100000:2.0:1790391304.030623:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169532416 00000100:00100000:2.0:1790391304.030681:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 191 00000100:00100000:2.0:1790391304.030701:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6144:x1877361169532416:12345-192.168.202.28@tcp:501: 00000100:00100000:2.0:1790391304.030909:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6144:x1877361169532416:12345-192.168.202.28@tcp:501: Request processed in 208us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391304.030917:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 191 00000100:00100000:0.0:1790391304.034630:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391304.034734:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169532544 00000100:00100000:1.0:1790391304.034755:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169532544 00000100:00100000:1.0:1790391304.034816:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 192 00000100:00100000:1.0:1790391304.034825:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6144:x1877361169532544:12345-192.168.202.28@tcp:503: 00000100:00100000:1.0:1790391304.034991:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6144:x1877361169532544:12345-192.168.202.28@tcp:503: Request processed in 166us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391304.034999:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 192 00000100:00100000:3.0:1790391304.046515:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391304.047431:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169532672 00000100:00100000:1.0:1790391304.047442:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169532672 00000100:00100000:1.0:1790391304.047499:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 193 00000100:00100000:1.0:1790391304.047510:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6170:x1877361169532672:12345-192.168.202.28@tcp:502: 00000100:00100000:1.0:1790391304.047660:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6170:x1877361169532672:12345-192.168.202.28@tcp:502: Request processed in 151us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391304.047668:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 193 00000100:00100000:0.0:1790391304.051591:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391304.051707:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169532800 00000100:00100000:2.0:1790391304.051718:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169532800 00000100:00100000:2.0:1790391304.051776:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 194 00000100:00100000:2.0:1790391304.051795:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6170:x1877361169532800:12345-192.168.202.28@tcp:502: 00000100:00100000:2.0:1790391304.051974:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6170:x1877361169532800:12345-192.168.202.28@tcp:502: Request processed in 188us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391304.051983:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 194 00000100:00100000:0.0:1790391304.056273:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391304.056325:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391304.056406:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169532928 00000100:00100000:3.0:1790391304.056415:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169532928 00000100:00100000:3.0:1790391304.056453:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169533184 00000100:00100000:3.0:1790391304.056456:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169533184 00000100:00100000:3.0:1790391304.056469:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:3.0:1790391304.056477:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2380:x1877361169532928:12345-192.168.202.28@tcp:38: 00010000:00080000:3.0:1790391304.056521:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:3.0:1790391304.056585:0:6513:0:(genops.c:1385:class_connect()) connect: client 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d, cookie 0x2b1b7949f13e0f4f 00000004:00100000:3.0:1790391304.056608:0:6513:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790391304.056820:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9e5183834800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391304.056913:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2380:x1877361169532928:12345-192.168.202.28@tcp:38: Request processed in 434us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391304.056921:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:3.0:1790391304.056939:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:3.0:1790391304.056943:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2380:x1877361169533184:12345-192.168.202.28@tcp:38: 00010000:00080000:3.0:1790391304.056957:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:3.0:1790391304.056988:0:6513:0:(genops.c:1385:class_connect()) connect: client 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d, cookie 0x2b1b7949f13e0f56 00000004:00100000:3.0:1790391304.057000:0:6513:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790391304.057145:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391304.057170:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2380:x1877361169533184:12345-192.168.202.28@tcp:38: Request processed in 225us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391304.057177:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 8 00010000:00010000:3.0:1790391304.136127:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391304.200171:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391304.200200:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186358656:0@lo:41: 00000100:00100000:3.0:1790391304.200289:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391304.200573:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186358656 00000100:00100000:1.0:1790391304.200582:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186358656 00000100:00100000:1.0:1790391304.200638:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790391304.200649:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186358656:12345-0@lo:41: 00000004:00000024:1.0:1790391304.200693:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1790391304.200753:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186358656:12345-0@lo:41: Request processed in 105us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391304.200761:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790391304.200948:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186358656:0@lo:41: 00000100:00100000:3.0:1790391305.079580:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391305.079627:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391305.079794:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169533312 00000100:00100000:1.0:1790391305.079805:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169533312 00000100:00100000:1.0:1790391305.079924:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169533056 00000100:00100000:1.0:1790391305.079928:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169533056 00000100:00100000:1.0:1790391305.079950:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:1.0:1790391305.079960:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:0:x1877361169533312:12345-192.168.202.28@tcp:41: 00000004:00000024:1.0:1790391305.080020:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790391305.080102:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:0:x1877361169533312:12345-192.168.202.28@tcp:41: Request processed in 143us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391305.080110:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:1.0:1790391305.080127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:1.0:1790391305.080134:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:0:x1877361169533056:12345-192.168.202.28@tcp:41: 00000004:00000024:1.0:1790391305.080150:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1790391305.080175:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:0:x1877361169533056:12345-192.168.202.28@tcp:41: Request processed in 42us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391305.080181:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00080000:0.0:1790391305.080299:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391305.080304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391305.084349:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391305.087065:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169533440 00000100:00100000:0.0:1790391305.087082:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169533440 00000100:00100000:0.0:1790391305.087171:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:0.0:1790391305.087183:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6144:x1877361169533440:12345-192.168.202.28@tcp:41: 00000004:00000024:0.0:1790391305.087228:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1790391305.087321:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6144:x1877361169533440:12345-192.168.202.28@tcp:41: Request processed in 139us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.087328:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:0.0:1790391305.090976:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391305.091056:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169533568 00000100:00100000:3.0:1790391305.091068:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169533568 00000100:00100000:3.0:1790391305.091153:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:3.0:1790391305.091163:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6144:x1877361169533568:12345-192.168.202.28@tcp:40: 00000100:00100000:3.0:1790391305.091525:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6144:x1877361169533568:12345-192.168.202.28@tcp:40: Request processed in 362us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391305.091532:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:3.0:1790391305.094539:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391305.094574:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391305.094606:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391305.094639:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169534080 00000100:00100000:1.0:1790391305.094649:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169534080 00000100:00100000:3.0:1790391305.094698:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391305.094707:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 195 00000100:00100000:1.0:1790391305.094718:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2381:x1877361169534080:12345-192.168.202.28@tcp:400: 00000100:00100000:0.0:1790391305.094742:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169533952 00000100:00100000:0.0:1790391305.094747:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169533952 00000100:00100000:0.0:1790391305.094777:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:0.0:1790391305.094784:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6144:x1877361169533952:12345-192.168.202.28@tcp:900: 00000100:00100000:1.0:1790391305.094995:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2381:x1877361169534080:12345-192.168.202.28@tcp:400: Request processed in 278us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391305.095002:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 195 00000100:00100000:0.0:1790391305.095081:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6144:x1877361169533952:12345-192.168.202.28@tcp:900: Request processed in 297us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.095106:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:2.0:1790391305.095150:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169533696 00000100:00100000:2.0:1790391305.095154:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169533696 00000100:00100000:2.0:1790391305.095224:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169533824 00000100:00100000:2.0:1790391305.095228:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169533824 00000100:00100000:0.0:1790391305.095285:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:1.0:1790391305.095291:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:0.0:1790391305.095291:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2380:x1877361169533696:12345-192.168.202.28@tcp:8: 00000100:00100000:1.0:1790391305.095296:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2380:x1877361169533824:12345-192.168.202.28@tcp:8: 00010000:00080000:1.0:1790391305.095321:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp t0 exp 0000000000000000 cur 218 last 0 00010000:00080000:0.0:1790391305.095321:0:9796:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1790391305.095357:0:8429:0:(genops.c:1385:class_connect()) connect: client 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d, cookie 0x2b1b7949f13e0f5d 00002000:00100000:1.0:1790391305.095368:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d/ffff9e5182264000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790391305.095384:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:00000080:0.0:1790391305.095508:0:9796:0:(genops.c:1385:class_connect()) connect: client 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d, cookie 0x2b1b7949f13e0f64 00002000:00100000:0.0:1790391305.095513:0:9796:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d/ffff9e5183373800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391305.095525:0:9796:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790391305.095566:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790391305.095592:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e5182263000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391305.095625:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2380:x1877361169533824:12345-192.168.202.28@tcp:8: Request processed in 328us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391305.095631:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 17 00002000:00080000:0.0:1790391305.095646:0:9796:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790391305.095661:0:9796:0:(import.c:65:import_set_state_nolock()) ffff9e5183373000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391305.095687:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2380:x1877361169533696:12345-192.168.202.28@tcp:8: Request processed in 395us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.095694:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:1.0:1790391305.098350:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391305.099523:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169534208 00000100:00100000:0.0:1790391305.099534:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169534208 00000100:00100000:0.0:1790391305.099590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:0.0:1790391305.099600:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6144:x1877361169534208:12345-192.168.202.28@tcp:33: 00000004:00080000:0.0:1790391305.112304:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 12616us 00000004:00200000:0.0:1790391305.122030:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790391305.122141:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6144:x1877361169534208:12345-192.168.202.28@tcp:33: Request processed in 22537us (23795us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.122151:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00010000:00010000:0.0:1790391305.160092:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391305.280017:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391305.280126:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169534336 00000100:00100000:2.0:1790391305.280137:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169534336 00000100:00100000:2.0:1790391305.280207:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:2.0:1790391305.280218:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6188:x1877361169534336:12345-192.168.202.28@tcp:101: 00010000:00010000:2.0:1790391305.280239:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391305.280314:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e529566c800/0x2b1b7949f13e0f6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0019 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391305.280389:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e0f72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391305.280404:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e0f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391305.280436:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e0f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391305.280499:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790391305.280503:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391305.280519:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e0f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391305.280547:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e529566c800/0x2b1b7949f13e0f6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0019 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391305.280566:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e0f72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0019 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391305.280576:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b5d77800) 00010000:00010000:2.0:1790391305.280579:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391305.280582:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52813a2c00, rc 0) 00000100:00100000:2.0:1790391305.280648:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:6188:x1877361169534336:12345-192.168.202.28@tcp:101: Request processed in 431us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391305.280655:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:3.0:1790391305.736104:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186358784:0@lo:400: 00000100:00100000:3.0:1790391305.736229:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391305.736338:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186358784 00000100:00100000:1.0:1790391305.736347:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186358784 00000100:00100000:1.0:1790391305.736402:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790391305.736413:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5289dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186358784:12345-0@lo:400: 00000100:00100000:0.0:1790391305.736517:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186359040:0@lo:400: 00000100:00100000:0.0:1790391305.736556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391305.736595:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391305.736601:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186358912:0@lo:400: 00000100:00100000:0.0:1790391305.736626:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391305.736650:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186359168:0@lo:400: 00000100:00100000:0.0:1790391305.736683:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391305.736718:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186359040 00000100:00100000:0.0:1790391305.736722:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186359040 00000100:00100000:0.0:1790391305.736750:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790391305.736756:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186359040:12345-0@lo:400: 00000100:00100000:0.0:1790391305.736805:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186359040:12345-0@lo:400: Request processed in 49us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.736811:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790391305.736850:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186359040:0@lo:400: 00000100:00100000:0.0:1790391305.736931:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186358912 00000100:00100000:0.0:1790391305.736935:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186358912 00000100:00100000:0.0:1790391305.736957:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186359168 00000100:00100000:0.0:1790391305.736960:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186359168 00000100:00100000:0.0:1790391305.736972:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790391305.736978:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186358912:12345-0@lo:400: 00000100:00100000:0.0:1790391305.737012:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186358912:12345-0@lo:400: Request processed in 34us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.737019:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790391305.737030:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790391305.737036:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186359168:12345-0@lo:400: 00000100:00100000:0.0:1790391305.737067:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186359168:12345-0@lo:400: Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.737073:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790391305.737105:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186359168:0@lo:400: 00000100:00100000:0.0:1790391305.737124:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186358912:0@lo:400: 00000100:00100000:1.0:1790391305.737774:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5289dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186358784:12345-0@lo:400: Request processed in 1362us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391305.737782:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790391305.737826:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186359424:0@lo:400: 00000100:00100000:0.0:1790391305.737932:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186359680:0@lo:400: 00000100:00100000:0.0:1790391305.737969:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391305.737980:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391305.737988:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186360192:0@lo:400: 00000100:00100000:1.0:1790391305.737999:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186359936:0@lo:400: 00000100:00100000:0.0:1790391305.738006:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391305.738016:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391305.738023:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790391305.738028:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186359296:0@lo:400: 00000100:00100000:1.0:1790391305.738029:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790391305.738033:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186359552:0@lo:400: 00000100:00100000:0.0:1790391305.738047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391305.738049:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391305.738061:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186360064:0@lo:400: 00000100:00100000:0.0:1790391305.738061:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186359808:0@lo:400: 00000100:00100000:0.0:1790391305.738077:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391305.738078:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391305.738092:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186360320:0@lo:400: 00000100:00100000:1.0:1790391305.738097:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186359424 00000100:00100000:1.0:1790391305.738102:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186359424 00000100:00100000:0.0:1790391305.738108:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391305.738146:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186359936 00000100:00100000:1.0:1790391305.738150:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186359936 00000100:00100000:1.0:1790391305.738162:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186359552 00000100:00100000:1.0:1790391305.738170:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186359552 00000100:00100000:1.0:1790391305.738186:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186360064 00000100:00100000:1.0:1790391305.738189:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186360064 00000100:00100000:0.0:1790391305.738205:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186359680 00000100:00100000:0.0:1790391305.738208:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186359680 00000100:00100000:1.0:1790391305.738212:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790391305.738218:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186359424:12345-0@lo:400: 00000100:00100000:0.0:1790391305.738226:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186360192 00000100:00100000:0.0:1790391305.738228:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186360192 00000100:00100000:0.0:1790391305.738238:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186359808 00000100:00100000:0.0:1790391305.738240:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186359808 00000100:00100000:0.0:1790391305.738251:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186360320 00000100:00100000:0.0:1790391305.738253:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186360320 00000100:00100000:1.0:1790391305.738254:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186359424:12345-0@lo:400: Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391305.738260:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790391305.738264:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391305.738270:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790391305.738270:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186359680:12345-0@lo:400: 00000100:00100000:1.0:1790391305.738274:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186359936:12345-0@lo:400: 00000100:00100000:1.0:1790391305.738297:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186359936:12345-0@lo:400: Request processed in 22us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.738300:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186359680:12345-0@lo:400: Request processed in 32us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391305.738303:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790391305.738306:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391305.738313:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790391305.738314:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391305.738318:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186359552:12345-0@lo:400: 00000100:00100000:0.0:1790391305.738385:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186360192:12345-0@lo:400: 00000100:00100000:0.0:1790391305.738416:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186360192:12345-0@lo:400: Request processed in 92us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.738422:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391305.738432:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391305.738437:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186359808:12345-0@lo:400: 00000100:00100000:0.0:1790391305.738460:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186359808:12345-0@lo:400: Request processed in 24us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.738465:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391305.738474:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391305.738479:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186360320:12345-0@lo:400: 00000100:00100000:0.0:1790391305.738502:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186360320:12345-0@lo:400: Request processed in 22us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.738507:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790391305.738535:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a7b80 x1877361186359808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391305.738546:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186359808:0@lo:400: 00010000:00080000:0.0:1790391305.738556:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77e8e00 x1877361186360320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391305.738563:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186360320:0@lo:400: 00010000:00080000:0.0:1790391305.738571:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a4e00 x1877361186359680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391305.738579:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186359680:0@lo:400: 00010000:00080000:0.0:1790391305.738587:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77eaa00 x1877361186360192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391305.738601:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186360192:0@lo:400: 00000100:00100000:1.0:1790391305.738634:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186359552:12345-0@lo:400: Request processed in 315us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391305.738637:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790391305.738640:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790391305.738651:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790391305.738656:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186360064:12345-0@lo:400: 00000100:00100000:1.0:1790391305.738683:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186360064:12345-0@lo:400: Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391305.738689:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1790391305.738728:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a6300 x1877361186359552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391305.738737:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186359552:0@lo:400: 00000100:00100000:3.0:1790391305.738741:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186358784:0@lo:400: 00010000:00080000:1.0:1790391305.738756:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518206f100 x1877361186360064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391305.738763:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186360064:0@lo:400: 00000100:00100000:1.0:1790391305.738772:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186359936:0@lo:400: 00000100:00080000:3.0:1790391305.738773:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391305.738777:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391305.738779:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391305.738781:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391305.738781:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186359424:0@lo:400: 00000100:00100000:0.0:1790391305.738893:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790391305.738895:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186359296 00000100:00100000:2.0:1790391305.738899:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186359296 00000100:00100000:2.0:1790391305.738923:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790391305.738934:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186359296:12345-0@lo:400: 00000100:00100000:2.0:1790391305.738972:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186359296:12345-0@lo:400: Request processed in 43us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391305.738979:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790391305.738986:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186359296:0@lo:400: 00010000:00010000:3.0:1790391306.185741:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391306.248133:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391306.248172:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186360448:0@lo:13: 00000100:00100000:2.0:1790391306.248258:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391306.248575:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186360448 00000100:00100000:3.0:1790391306.248584:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186360448 00000100:00100000:3.0:1790391306.248639:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391306.248650:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186360448:12345-0@lo:13: 00002000:00000024:3.0:1790391306.248674:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391306.248733:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186360448:12345-0@lo:13: Request processed in 85us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391306.248741:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1790391306.248820:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5181cb8a80 x1877361186360448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391306.248840:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186360448:0@lo:13: 00000100:00100000:0.0:1790391306.249285:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186360576:0@lo:13: 00000100:00100000:0.0:1790391306.249318:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391306.249584:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186360576 00000100:00100000:3.0:1790391306.249599:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186360576 00000100:00100000:3.0:1790391306.249637:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391306.249644:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186360576:12345-0@lo:13: 00002000:00000024:3.0:1790391306.249660:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391306.252849:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186360576:12345-0@lo:13: Request processed in 3185us (3510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391306.252864:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1790391306.253515:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77ea300 x1877361186360576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391306.253541:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186360576:0@lo:13: 00010000:00010000:0.0:1790391307.211037:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391307.259382:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391307.260516:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169534464 00000100:00100000:1.0:1790391307.260527:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169534464 00000100:00100000:1.0:1790391307.260606:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:1.0:1790391307.260618:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:6240:x1877361169534464:12345-192.168.202.28@tcp:41: 00000100:00080000:3.0:1790391307.260746:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1790391307.261260:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1790391307.261336:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:6240:x1877361169534464:12345-192.168.202.28@tcp:41: Request processed in 719us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391307.261344:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:1.0:1790391307.267750:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391307.267939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169534592 00000100:00100000:0.0:1790391307.267950:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169534592 00000100:00100000:0.0:1790391307.268025:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:0.0:1790391307.268036:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6240:x1877361169534592:12345-192.168.202.28@tcp:41: 00000004:00000024:0.0:1790391307.268074:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:3.0:1790391307.268266:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391307.268359:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6240:x1877361169534592:12345-192.168.202.28@tcp:41: Request processed in 323us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391307.268367:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:3.0:1790391307.272143:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186360832:0@lo:13: 00000100:00100000:3.0:1790391307.272226:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391307.272306:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391307.272312:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186360704:0@lo:13: 00000100:00100000:3.0:1790391307.272334:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391307.272367:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186360832 00000100:00100000:3.0:1790391307.272374:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186360832 00000100:00100000:3.0:1790391307.272421:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186360704 00000100:00100000:3.0:1790391307.272424:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186360704 00000100:00100000:3.0:1790391307.272454:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391307.272463:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186360832:12345-0@lo:13: 00002000:00000024:3.0:1790391307.272492:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391307.272533:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186360832:12345-0@lo:13: Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391307.272540:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391307.272557:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391307.272563:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186360704:12345-0@lo:13: 00002000:00000024:3.0:1790391307.272573:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391307.272597:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186360704:12345-0@lo:13: Request processed in 34us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391307.272615:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1790391307.272631:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790391307.272672:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77ead80 x1877361186360704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391307.272692:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186360704:0@lo:13: 00010000:00080000:3.0:1790391307.272705:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831dd180 x1877361186360832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391307.272715:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186360832:0@lo:13: 00000100:00100000:0.0:1790391307.273530:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391307.273543:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186360960:0@lo:41: 00000100:00100000:0.0:1790391307.273588:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391307.273635:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186360960 00000100:00100000:0.0:1790391307.273640:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186360960 00000100:00100000:0.0:1790391307.273687:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790391307.273696:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186360960:12345-0@lo:41: 00000004:00000024:0.0:1790391307.273715:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391307.273752:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186360960:12345-0@lo:41: Request processed in 58us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391307.273770:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790391307.273806:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186360960:0@lo:41: 00000100:00100000:3.0:1790391307.284493:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391307.284589:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169534720 00000100:00100000:0.0:1790391307.284600:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169534720 00000100:00100000:0.0:1790391307.284687:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:0.0:1790391307.284698:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6240:x1877361169534720:12345-192.168.202.28@tcp:13: 00002000:00000024:0.0:1790391307.284726:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391307.284802:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6240:x1877361169534720:12345-192.168.202.28@tcp:13: Request processed in 106us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391307.284810:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00080000:3.0:1790391307.285476:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391307.290150:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391307.290337:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169534848 00000100:00100000:0.0:1790391307.290348:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169534848 00000100:00100000:0.0:1790391307.290428:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:0.0:1790391307.290440:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6240:x1877361169534848:12345-192.168.202.28@tcp:13: 00002000:00000024:0.0:1790391307.290480:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391307.290562:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:6240:x1877361169534848:12345-192.168.202.28@tcp:13: Request processed in 124us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391307.290569:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00080000:3.0:1790391307.294850:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790391308.232291:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790391308.812035:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00010000:00010000:0.0:1790391309.256165:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391309.320581:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186361088:0@lo:41: 00000100:00100000:0.0:1790391309.320656:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391309.320797:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186361088 00000100:00100000:2.0:1790391309.320806:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186361088 00000100:00100000:2.0:1790391309.320863:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790391309.320873:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186361088:12345-0@lo:41: 00000004:00000024:2.0:1790391309.320932:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1790391309.320987:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186361088:12345-0@lo:41: Request processed in 115us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391309.320994:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391309.321229:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186361088:0@lo:41: 00000001:00100000:0.0:1790391309.833574:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000001:00100000:3.0:1790391309.833839:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000100:00100000:1.0:1790391310.219348:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391310.219871:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391310.219920:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391310.219947:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391310.219979:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169535488 00000100:00100000:3.0:1790391310.219991:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169535488 00000100:00100000:1.0:1790391310.219994:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391310.220022:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169535232 00000100:00100000:1.0:1790391310.220026:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169535232 00000100:00100000:3.0:1790391310.220052:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169535360 00000100:00100000:3.0:1790391310.220056:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169535360 00000100:00100000:3.0:1790391310.220081:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:3.0:1790391310.220090:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169535488:12345-192.168.202.28@tcp:400: 00000100:00100000:3.0:1790391310.220172:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169535488:12345-192.168.202.28@tcp:400: Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391310.220180:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:1.0:1790391310.220193:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169535104 00000100:00100000:1.0:1790391310.220198:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169535104 00000100:00100000:3.0:1790391310.220201:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:3.0:1790391310.220209:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169535360:12345-192.168.202.28@tcp:400: 00000100:00100000:3.0:1790391310.220233:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169535360:12345-192.168.202.28@tcp:400: Request processed in 25us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391310.220247:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00080000:3.0:1790391310.220281:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391310.220288:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391310.220291:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391310.220294:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:1.0:1790391310.220302:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169535232:12345-192.168.202.28@tcp:400: 00000100:00080000:3.0:1790391310.220303:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391310.220400:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169535232:12345-192.168.202.28@tcp:400: Request processed in 98us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391310.220407:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:1.0:1790391310.220424:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:1.0:1790391310.220433:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169535104:12345-192.168.202.28@tcp:400: 00000100:00100000:1.0:1790391310.221103:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169535104:12345-192.168.202.28@tcp:400: Request processed in 614us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391310.221112:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:2.0:1790391310.228807:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169534976 00000100:00100000:2.0:1790391310.228822:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169534976 00000100:00100000:2.0:1790391310.228899:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 197 00000100:00100000:2.0:1790391310.228910:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2384:x1877361169534976:12345-192.168.202.28@tcp:400: 00000100:00100000:2.0:1790391310.228979:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2384:x1877361169534976:12345-192.168.202.28@tcp:400: Request processed in 72us (9641us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391310.228988:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 197 00010000:00010000:3.0:1790391310.280041:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790391310.346574:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000001:02000400:3.0:1790391310.477852:0:10177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790391310.856138:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186361216:0@lo:400: 00000100:00100000:0.0:1790391310.856253:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391310.856367:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186361216 00000100:00100000:2.0:1790391310.856375:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186361216 00000100:00100000:2.0:1790391310.856447:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790391310.856456:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186361216:12345-0@lo:400: 00000100:00100000:3.0:1790391310.857709:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186361344:0@lo:400: 00000100:00100000:3.0:1790391310.857771:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391310.857834:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186361344 00000100:00100000:3.0:1790391310.857840:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186361344 00000100:00100000:3.0:1790391310.857896:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790391310.857905:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186361344:12345-0@lo:400: 00000100:00100000:3.0:1790391310.857948:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186361344:12345-0@lo:400: Request processed in 44us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391310.857954:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790391310.857997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186361344:0@lo:400: 00000100:00100000:2.0:1790391310.859671:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186361216:12345-0@lo:400: Request processed in 3208us (3410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391310.859684:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790391310.863934:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186361216:0@lo:400: 00000100:00100000:3.0:1790391310.865028:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186361472:0@lo:400: 00000100:00100000:3.0:1790391310.865097:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391310.865229:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186361600:0@lo:400: 00000100:00100000:2.0:1790391310.865277:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391310.865370:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186361472 00000100:00100000:0.0:1790391310.865377:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186361472 00000100:00100000:0.0:1790391310.865438:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790391310.865447:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186361472:12345-0@lo:400: 00000100:00100000:1.0:1790391310.874060:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186361600 00000100:00100000:1.0:1790391310.874072:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186361600 00000100:00100000:1.0:1790391310.874125:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790391310.874135:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186361600:12345-0@lo:400: 00000100:00100000:1.0:1790391310.874231:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186361600:12345-0@lo:400: Request processed in 97us (8953us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391310.874238:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790391310.874270:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186362112:0@lo:400: 00000100:00100000:1.0:1790391310.874308:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391310.874333:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186362624:0@lo:400: 00000100:00100000:1.0:1790391310.874353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391310.874385:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186361600:0@lo:400: 00000100:00100000:1.0:1790391310.874402:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790391310.874407:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186361984:0@lo:400: 00000100:00100000:1.0:1790391310.874492:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391310.874523:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186362496:0@lo:400: 00000100:00100000:1.0:1790391310.874543:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391310.874568:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186362112 00000100:00100000:1.0:1790391310.874571:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186362112 00000100:00100000:1.0:1790391310.874603:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186362624 00000100:00100000:1.0:1790391310.874605:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186362624 00000100:00100000:1.0:1790391310.874624:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391310.874701:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186362112:12345-0@lo:400: 00000100:00100000:1.0:1790391310.874792:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186362112:12345-0@lo:400: Request processed in 161us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391310.874798:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391310.874809:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391310.874815:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186362624:12345-0@lo:400: 00000100:00100000:1.0:1790391310.874841:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186362624:12345-0@lo:400: Request processed in 27us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391310.874846:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1790391310.874861:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391310.874865:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391310.874902:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186361984 00000100:00100000:1.0:1790391310.874906:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186361984 00000100:00100000:1.0:1790391310.874930:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186362496 00000100:00100000:1.0:1790391310.874933:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186362496 00000100:00100000:1.0:1790391310.874951:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790391310.874957:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186361984:12345-0@lo:400: 00000100:00100000:1.0:1790391310.874985:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186361984:12345-0@lo:400: Request processed in 28us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391310.874990:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790391310.874999:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391310.875010:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186362496:12345-0@lo:400: 00000100:00100000:1.0:1790391310.875035:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186362496:12345-0@lo:400: Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391310.875040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1790391310.875055:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1790391310.875071:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831bb100 x1877361186361984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391310.875081:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186361984:0@lo:400: 00010000:00080000:1.0:1790391310.875090:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831b8a80 x1877361186362496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391310.875097:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186362496:0@lo:400: 00010000:00080000:1.0:1790391310.875105:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831b8380 x1877361186362112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391310.875111:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186362112:0@lo:400: 00010000:00080000:1.0:1790391310.875118:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831b9500 x1877361186362624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391310.875125:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186362624:0@lo:400: 00000100:00100000:1.0:1790391310.875183:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186361856:0@lo:400: 00000100:00100000:1.0:1790391310.875209:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391310.875225:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186362368:0@lo:400: 00000100:00100000:1.0:1790391310.875243:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391310.875259:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790391310.875265:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186361728:0@lo:400: 00000100:00100000:1.0:1790391310.875286:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391310.875311:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186362240:0@lo:400: 00000100:00100000:1.0:1790391310.875333:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391310.875348:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186362752:0@lo:400: 00000100:00100000:1.0:1790391310.875365:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391310.875386:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186361856 00000100:00100000:1.0:1790391310.875389:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186361856 00000100:00100000:2.0:1790391310.876245:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186362240 00000100:00100000:2.0:1790391310.876252:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186362240 00000100:00100000:2.0:1790391310.876289:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186362752 00000100:00100000:2.0:1790391310.876291:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186362752 00000100:00100000:2.0:1790391310.876304:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790391310.876310:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186362240:12345-0@lo:400: 00000100:00100000:2.0:1790391310.876358:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186362240:12345-0@lo:400: Request processed in 48us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391310.876363:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790391310.876375:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790391310.876380:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186362752:12345-0@lo:400: 00000100:00100000:2.0:1790391310.876401:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186362752:12345-0@lo:400: Request processed in 21us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391310.876407:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1790391310.876448:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831bb480 x1877361186362240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391310.876458:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186362240:0@lo:400: 00010000:00080000:2.0:1790391310.876468:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831bb800 x1877361186362752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391310.876476:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186362752:0@lo:400: 00000100:00100000:2.0:1790391310.876513:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186362368 00000100:00100000:2.0:1790391310.876516:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186362368 00000100:00100000:2.0:1790391310.876541:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391310.876546:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186362368:12345-0@lo:400: 00000100:00100000:2.0:1790391310.876585:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186362368:12345-0@lo:400: Request processed in 39us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391310.876602:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391310.876640:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186362368:0@lo:400: 00000100:00080000:2.0:1790391310.876666:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391310.876670:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391310.876672:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391310.877892:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186361728 00000100:00100000:1.0:1790391310.877900:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186361728 00000100:00100000:1.0:1790391310.877939:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790391310.877947:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186361728:12345-0@lo:400: 00000100:00100000:1.0:1790391310.878007:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186361728:12345-0@lo:400: Request processed in 61us (2719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391310.878013:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790391310.878046:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186361728:0@lo:400: 00000100:00100000:0.0:1790391310.878608:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186361472:12345-0@lo:400: Request processed in 13160us (13508us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391310.878616:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391310.878864:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790391310.878872:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186361856:12345-0@lo:400: 00000100:00100000:2.0:1790391310.878939:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186361856:12345-0@lo:400: Request processed in 68us (3730us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391310.878946:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1790391310.879525:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391310.879559:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186361856:0@lo:400: 00000100:00100000:3.0:1790391310.879827:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186361472:0@lo:400: 00010000:00010000:0.0:1790391311.305193:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391311.370155:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186362880:0@lo:13: 00000100:00100000:0.0:1790391311.370226:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391311.370291:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186362880 00000100:00100000:0.0:1790391311.370298:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186362880 00000100:00100000:0.0:1790391311.370339:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391311.370347:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186362880:12345-0@lo:13: 00002000:00000024:0.0:1790391311.370375:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391311.370416:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186362880:12345-0@lo:13: Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391311.370435:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1790391311.370472:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a6a00 x1877361186362880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391311.370521:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186362880:0@lo:13: 00000100:00100000:2.0:1790391311.370640:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391311.370651:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186363008:0@lo:13: 00000100:00100000:2.0:1790391311.370679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391311.370711:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186363008 00000100:00100000:2.0:1790391311.370714:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186363008 00000100:00100000:2.0:1790391311.370736:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790391311.370742:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186363008:12345-0@lo:13: 00002000:00000024:2.0:1790391311.370751:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391311.370779:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186363008:12345-0@lo:13: Request processed in 37us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391311.370786:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790391311.370812:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77e9880 x1877361186363008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391311.370824:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186363008:0@lo:13: 00010000:00010000:3.0:1790391312.342943:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391312.392928:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391312.392956:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186363136:0@lo:13: 00000100:00100000:0.0:1790391312.393180:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391312.393191:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186363264:0@lo:13: 00000100:00100000:0.0:1790391312.393245:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391312.393408:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391312.393902:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186363264 00000100:00100000:2.0:1790391312.393911:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186363264 00000100:00100000:2.0:1790391312.393975:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186363136 00000100:00100000:2.0:1790391312.393979:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186363136 00000100:00100000:0.0:1790391312.394570:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790391312.394587:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186363264:12345-0@lo:13: 00002000:00000024:0.0:1790391312.394637:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391312.394704:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186363264:12345-0@lo:13: Request processed in 122us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391312.394835:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1790391312.394905:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a6a00 x1877361186363264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391312.394923:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186363264:0@lo:13: 00000100:00100000:2.0:1790391312.395316:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790391312.395326:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186363136:12345-0@lo:13: 00002000:00000024:2.0:1790391312.395338:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391312.395383:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186363136:12345-0@lo:13: Request processed in 59us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391312.395389:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1790391312.396582:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790391312.396817:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229df80 x1877361186363136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391312.396841:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186363136:0@lo:13: 00000100:00100000:3.0:1790391312.398195:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186363392:0@lo:41: 00000100:00100000:3.0:1790391312.398265:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391312.398492:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186363392 00000100:00100000:1.0:1790391312.398500:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186363392 00000100:00100000:1.0:1790391312.398555:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790391312.398564:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186363392:12345-0@lo:41: 00000004:00000024:1.0:1790391312.398598:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790391312.400863:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186363392:12345-0@lo:41: Request processed in 2291us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391312.400888:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790391312.401311:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186363392:0@lo:41: 00010000:00010000:2.0:1790391313.354181:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391314.376034:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391314.440218:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391314.440245:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186363520:0@lo:41: 00000100:00100000:2.0:1790391314.445711:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391314.445782:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186363520 00000100:00100000:0.0:1790391314.445801:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186363520 00000100:00100000:0.0:1790391314.449291:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790391314.450103:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186363520:12345-0@lo:41: 00000004:00000024:0.0:1790391314.450155:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1790391314.450242:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186363520:12345-0@lo:41: Request processed in 382us (4537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.450249:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790391314.450310:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186363520:0@lo:41: 00000020:00000080:3.0:1790391314.954992:0:10325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4fea3550 20000000:00000080:3.0:1790391314.955010:0:10325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e51831ea000 uarg=0000000000000000 20000000:01000000:3.0:1790391314.955064:0:10325:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1790391314.955066:0:10325:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1790391314.955069:0:10325:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790391314.955074:0:10325:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790391314.955080:0:10325:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1790391314.955155:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790391314.955157:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790391314.971852:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1790391314.972232:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1790391314.972266:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1790391314.972283:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1790391314.972305:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790391314.972309:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790391314.972640:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1790391314.972783:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1790391314.972804:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1790391314.972822:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1790391314.972831:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790391314.972834:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790391314.973528:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1790391314.973755:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1790391314.973776:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1790391314.973792:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1790391314.973800:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790391314.973803:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790391314.974669:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1790391314.975019:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1790391314.975045:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1790391314.975094:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1790391314.975116:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1790391314.975119:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790391314.975856:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1790391314.976138:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1790391314.976162:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1790391314.976178:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:2.0:1790391314.976192:0:10325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790391314.976211:0:10325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976230:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e0d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976239:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e37 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976246:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0e7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e76 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976253:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e84 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976270:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e92 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976277:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e529566da00/0x2b1b7949f13e0eb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0eae expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976284:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e0edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ed1 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976291:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e0efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ef4 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976298:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e0f25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0f1e expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976307:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eefe00/0x2b1b7949f13e0f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affa9 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976313:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e0f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affb0 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976321:0:10325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976361:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e0f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affb0 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976375:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e0f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affb0 expref: 9 pid: 6507 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.976401:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186363648:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391314.976506:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eefe00/0x2b1b7949f13e0f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affa9 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976514:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52b5eefe00/0x2b1b7949f13e0f33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affa9 expref: 9 pid: 6506 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.976522:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186363776:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391314.976552:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e0f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0f1e expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976561:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e0f25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0f1e expref: 23 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.976570:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186363904:0@lo:104: 00000100:00100000:2.0:1790391314.976609:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391314.976650:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e0efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0ef4 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976659:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e0efb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ef4 expref: 23 pid: 6506 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.976666:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186364032:0@lo:104: 00000100:00100000:2.0:1790391314.976686:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391314.976719:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186363904 00000100:00100000:2.0:1790391314.976726:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186363904 00000100:00100000:2.0:1790391314.976759:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186364032 00000100:00100000:2.0:1790391314.976768:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186364032 00000100:00100000:2.0:1790391314.976786:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790391314.976794:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:10325:x1877361186363904:12345-0@lo:104: 00010000:00010000:2.0:1790391314.976807:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976853:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391314.976859:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:10325:x1877361186363904:12345-0@lo:104: Request processed in 66us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391314.976866:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790391314.976918:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790391314.976926:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186364032:12345-0@lo:104: 00010000:00010000:2.0:1790391314.976933:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.976965:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391314.976970:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186364032:12345-0@lo:104: Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391314.976976:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1790391314.976992:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391314.976998:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977005:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031a00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391314.977008:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977016:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391314.977035:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391314.977041:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391314.977068:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977075:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391314.977090:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977097:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280031a00/0x2b1b7949f13e0f1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0f25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977120:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391314.977123:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977129:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566ca00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391314.977132:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977138:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391314.977144:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391314.977149:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391314.977169:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977175:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391314.977188:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977195:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e0ef4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0efb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977206:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.977207:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.977209:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391314.977216:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391314.977228:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186364160:0@lo:103: 00000100:00100000:2.0:1790391314.977259:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391314.977291:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e0edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0ed1 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977299:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e0edf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ed1 expref: 23 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.977308:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186364416:0@lo:104: 00000100:00100000:2.0:1790391314.977328:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391314.977344:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186364416 00000100:00100000:2.0:1790391314.977347:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186364416 00000100:00100000:2.0:1790391314.977363:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391314.977369:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186364416:12345-0@lo:104: 00010000:00010000:2.0:1790391314.977376:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977412:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391314.977417:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186364416:12345-0@lo:104: Request processed in 49us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391314.977424:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1790391314.977437:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391314.977441:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977446:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f7400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391314.977449:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977456:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391314.977462:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391314.977467:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391314.977481:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977487:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391314.977492:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977498:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0ed1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0edf expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977517:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.977518:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.977519:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.977535:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e529566da00/0x2b1b7949f13e0eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0eae expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977543:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e529566da00/0x2b1b7949f13e0eb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0eae expref: 23 pid: 6506 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.977552:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186364672:0@lo:104: 00000100:00100000:2.0:1790391314.977575:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391314.977599:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790391314.977606:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186364672 00000100:00100000:2.0:1790391314.977609:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186364672 00000100:00100000:2.0:1790391314.977625:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790391314.977630:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5182247850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186364672:12345-0@lo:104: 00010000:00010000:2.0:1790391314.977637:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977666:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391314.977671:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5182247850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186364672:12345-0@lo:104: Request processed in 41us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391314.977676:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1790391314.977706:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391314.977710:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977716:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566ce00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391314.977725:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977731:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391314.977737:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391314.977743:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391314.977756:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977762:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391314.977770:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977777:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e0eae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0eb5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977786:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.977788:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.977789:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391314.977800:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186364800:0@lo:103: 00000100:00100000:2.0:1790391314.977823:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391314.977857:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0e92 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.977865:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0e99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e92 expref: 23 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.977905:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186364928:0@lo:104: 00000100:00100000:2.0:1790391314.977929:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391314.977948:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186364928 00000100:00100000:2.0:1790391314.977952:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186364928 00000100:00100000:2.0:1790391314.977968:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790391314.977973:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186364928:12345-0@lo:104: 00010000:00010000:2.0:1790391314.977980:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978009:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391314.978013:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186364928:12345-0@lo:104: Request processed in 41us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391314.978019:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1790391314.978032:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391314.978035:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978041:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f7800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391314.978045:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978052:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391314.978058:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391314.978063:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391314.978082:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978088:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391314.978097:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978103:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7800/0x2b1b7949f13e0e92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e99 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978125:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.978127:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.978128:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391314.978138:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391314.978145:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186365056:0@lo:103: 00000100:00100000:2.0:1790391314.978180:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391314.978220:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0e84 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978228:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e84 expref: 23 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.978237:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186365184:0@lo:104: 00000100:00100000:2.0:1790391314.978259:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391314.978279:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186365184 00000100:00100000:2.0:1790391314.978282:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186365184 00000100:00100000:2.0:1790391314.978298:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790391314.978303:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186365184:12345-0@lo:104: 00010000:00010000:2.0:1790391314.978310:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978349:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391314.978354:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186365184:12345-0@lo:104: Request processed in 51us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391314.978360:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1790391314.978374:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391314.978377:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978383:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030e00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391314.978385:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978392:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391314.978398:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391314.978403:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391314.978417:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978423:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391314.978427:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978432:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280030e00/0x2b1b7949f13e0e84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e8b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978452:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.978454:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.978456:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.978474:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0e76 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978481:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e76 expref: 23 pid: 6505 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.978488:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186365440:0@lo:104: 00000100:00100000:2.0:1790391314.978509:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391314.978528:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186365440 00000100:00100000:2.0:1790391314.978531:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186365440 00000100:00100000:2.0:1790391314.978548:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391314.978553:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186365440:12345-0@lo:104: 00010000:00010000:2.0:1790391314.978560:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978589:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391314.978594:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186365440:12345-0@lo:104: Request processed in 42us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391314.978600:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1790391314.978611:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391314.978615:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978620:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391314.978623:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978636:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391314.978642:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391314.978647:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391314.978660:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978666:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391314.978671:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978678:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e0e76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e7d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978686:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.978688:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.978689:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.978707:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0e37 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978714:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0e3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e37 expref: 23 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.978723:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186365696:0@lo:104: 00000100:00100000:2.0:1790391314.978744:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391314.978763:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186365696 00000100:00100000:2.0:1790391314.978771:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186365696 00000100:00100000:2.0:1790391314.978788:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790391314.978793:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186365696:12345-0@lo:104: 00010000:00010000:2.0:1790391314.978801:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978831:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391314.978835:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186365696:12345-0@lo:104: Request processed in 42us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391314.978841:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1790391314.978853:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391314.978857:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978863:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391314.978866:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978872:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391314.978899:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391314.978904:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391314.978918:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978924:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391314.978933:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978946:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280031800/0x2b1b7949f13e0e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e3e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.978955:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.978957:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391314.978958:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391314.978970:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186365824:0@lo:103: 00000100:00100000:2.0:1790391314.978993:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391314.979022:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0e0d expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.979030:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0e14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e0d expref: 23 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.979038:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186365952:0@lo:104: 00000100:00100000:2.0:1790391314.979060:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391314.979077:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186365952 00000100:00100000:2.0:1790391314.979080:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186365952 00000100:00100000:2.0:1790391314.979096:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790391314.979101:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186365952:12345-0@lo:104: 00000100:00100000:0.0:1790391314.979260:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186364544:0@lo:103: 00000100:00100000:0.0:1790391314.979287:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391314.979298:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186365568:0@lo:103: 00000100:00100000:0.0:1790391314.979312:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391314.979322:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790391314.979326:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186364288:0@lo:103: 00000100:00100000:0.0:1790391314.979342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391314.979349:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186365312:0@lo:103: 00000100:00100000:0.0:1790391314.979365:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391314.979381:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186364160 00000100:00100000:0.0:1790391314.979384:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186364160 00010000:00010000:0.0:1790391314.979403:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e0f25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0f1e expref: 24 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.979416:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186364800 00000100:00100000:0.0:1790391314.979419:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186364800 00010000:00010000:0.0:1790391314.979429:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e529566da00/0x2b1b7949f13e0eb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0eae expref: 25 pid: 6506 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.979439:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186365056 00000100:00100000:0.0:1790391314.979441:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186365056 00010000:00010000:0.0:1790391314.979450:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0e99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e92 expref: 26 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.979460:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186365824 00000100:00100000:0.0:1790391314.979463:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186365824 00010000:00010000:0.0:1790391314.979470:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0e3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e37 expref: 27 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.979479:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186364544 00000100:00100000:0.0:1790391314.979489:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186364544 00010000:00010000:0.0:1790391314.979501:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e0edf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ed1 expref: 28 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.979512:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186365568 00000100:00100000:0.0:1790391314.979514:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186365568 00010000:00010000:0.0:1790391314.979524:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0e7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e76 expref: 29 pid: 6505 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.979533:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186364288 00000100:00100000:0.0:1790391314.979535:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186364288 00010000:00010000:0.0:1790391314.979544:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e0efb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ef4 expref: 30 pid: 6506 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.979552:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186365312 00000100:00100000:0.0:1790391314.979554:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186365312 00010000:00010000:0.0:1790391314.979562:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e84 expref: 31 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.979573:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790391314.979579:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae988c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+31:3639:x1877361186364160:12345-0@lo:103: 00010000:00010000:0.0:1790391314.979589:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.979594:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e0f25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0f1e expref: 31 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.979602:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e0f25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0f1e expref: 31 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.979617:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.979649:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae988c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+31:3639:x1877361186364160:12345-0@lo:103: Request processed in 70us (2390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.979656:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790391314.979699:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790391314.979704:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+30:3639:x1877361186364800:12345-0@lo:103: 00010000:00010000:0.0:1790391314.979711:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.979715:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e529566da00/0x2b1b7949f13e0eb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0eae expref: 30 pid: 6506 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.979722:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e529566da00/0x2b1b7949f13e0eb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0eae expref: 30 pid: 6506 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.979731:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.979752:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+30:3639:x1877361186364800:12345-0@lo:103: Request processed in 48us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.979758:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790391314.979769:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391314.979774:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+29:3639:x1877361186365056:12345-0@lo:103: 00010000:00010000:0.0:1790391314.979781:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.979785:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0e99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e92 expref: 29 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.979793:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0e99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e92 expref: 29 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.979801:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.979822:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+29:3639:x1877361186365056:12345-0@lo:103: Request processed in 48us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.979827:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790391314.979838:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391314.979843:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+28:3639:x1877361186365824:12345-0@lo:103: 00010000:00010000:0.0:1790391314.979850:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.979859:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0e3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e37 expref: 28 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.979866:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0e3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e37 expref: 28 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.979891:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.979915:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+28:3639:x1877361186365824:12345-0@lo:103: Request processed in 72us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.979921:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391314.979932:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391314.979938:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+27:3638:x1877361186364544:12345-0@lo:103: 00010000:00010000:0.0:1790391314.979945:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.979949:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e0edf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ed1 expref: 27 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.979957:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e0edf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ed1 expref: 27 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.979965:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.979990:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+27:3638:x1877361186364544:12345-0@lo:103: Request processed in 52us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.979996:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391314.980008:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391314.980014:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+26:3638:x1877361186365568:12345-0@lo:103: 00010000:00010000:0.0:1790391314.980021:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.980025:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0e7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e76 expref: 26 pid: 6505 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.980042:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e76 expref: 26 pid: 6505 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.980052:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.980074:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+26:3638:x1877361186365568:12345-0@lo:103: Request processed in 61us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.980096:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391314.980119:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790391314.980126:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+25:3638:x1877361186364288:12345-0@lo:103: 00010000:00010000:0.0:1790391314.980133:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.980138:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e0efb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ef4 expref: 25 pid: 6506 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.980146:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e0efb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ef4 expref: 25 pid: 6506 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.980155:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.980175:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+25:3638:x1877361186364288:12345-0@lo:103: Request processed in 50us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.980181:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790391314.980192:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790391314.980197:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae989850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186365312:12345-0@lo:103: 00010000:00010000:0.0:1790391314.980203:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.980207:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e84 expref: 24 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.980215:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e84 expref: 24 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.980229:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.980251:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae989850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186365312:12345-0@lo:103: Request processed in 55us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.980256:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790391314.980311:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186365824:0@lo:103: 00000100:00100000:0.0:1790391314.980321:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186365056:0@lo:103: 00000100:00100000:0.0:1790391314.980329:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186364800:0@lo:103: 00000100:00100000:0.0:1790391314.980336:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186364160:0@lo:103: 00000100:00100000:0.0:1790391314.980381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186364288:0@lo:103: 00000100:00100000:0.0:1790391314.980388:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186365312:0@lo:103: 00000100:00100000:0.0:1790391314.980393:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186364544:0@lo:103: 00000100:00100000:0.0:1790391314.980399:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186365568:0@lo:103: 00010000:00010000:0.0:1790391314.982979:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391314.984639:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391314.984717:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391314.984742:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169535616 00000100:00100000:0.0:1790391314.984750:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169535616 00010000:00010000:0.0:1790391314.984788:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e0f3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affb0 expref: 10 pid: 6507 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.984816:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169535744 00000100:00100000:0.0:1790391314.984819:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169535744 00010000:00010000:0.0:1790391314.984832:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eefe00/0x2b1b7949f13e0f33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affa9 expref: 11 pid: 6506 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.984859:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:0.0:1790391314.984868:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:2383:x1877361169535616:12345-192.168.202.28@tcp:103: 00010000:00010000:0.0:1790391314.984908:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.984915:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e0f3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affb0 expref: 11 pid: 6507 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.984927:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e0f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affb0 expref: 11 pid: 6507 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.984946:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.984993:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:2383:x1877361169535616:12345-192.168.202.28@tcp:103: Request processed in 126us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.985001:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:0.0:1790391314.985019:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:0.0:1790391314.985026:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2384:x1877361169535744:12345-192.168.202.28@tcp:103: 00010000:00010000:0.0:1790391314.985033:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.985037:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eefe00/0x2b1b7949f13e0f33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affa9 expref: 10 pid: 6506 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.985046:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eefe00/0x2b1b7949f13e0f33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affa9 expref: 10 pid: 6506 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.985056:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.985072:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2384:x1877361169535744:12345-192.168.202.28@tcp:103: Request processed in 47us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.985095:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 33 00010000:00010000:2.0:1790391314.985488:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.985546:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391314.985552:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10325:x1877361186365952:12345-0@lo:104: Request processed in 6450us (6491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391314.985560:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790391314.985611:0:10325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5283d16480 going to sleep for 11 seconds 00010000:00010000:2.0:1790391314.985638:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e0f3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affb0 expref: 9 pid: 6507 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.985652:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186363648:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391314.985664:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eefe00/0x2b1b7949f13e0f33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affa9 expref: 8 pid: 6506 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.985673:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186363776:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391314.985684:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e0f25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0f1e expref: 23 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.985693:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186363904:0@lo:104: 00010000:00010000:2.0:1790391314.985703:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e0efb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0ef4 expref: 22 pid: 6506 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.985711:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186364032:0@lo:104: 00010000:00010000:2.0:1790391314.985721:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e0edf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0ed1 expref: 21 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.985729:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186364416:0@lo:104: 00010000:00010000:2.0:1790391314.985739:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566da00/0x2b1b7949f13e0eb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0eae expref: 20 pid: 6506 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.985748:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186364672:0@lo:104: 00010000:00010000:2.0:1790391314.985759:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e0e99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0e92 expref: 19 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.985767:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186364928:0@lo:104: 00010000:00010000:2.0:1790391314.985787:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f7000/0x2b1b7949f13e0e8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0e84 expref: 18 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.985797:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186365184:0@lo:104: 00010000:00010000:2.0:1790391314.985807:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e0e7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0e76 expref: 17 pid: 6505 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.985814:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186365440:0@lo:104: 00010000:00010000:2.0:1790391314.985823:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e0e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0e37 expref: 16 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.985831:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186365696:0@lo:104: 00000100:00100000:2.0:1790391314.985839:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1877361186365952:0@lo:104: 00010000:00010000:2.0:1790391314.985922:0:10325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993359:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391314.993375:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993386:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f6200 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391314.993390:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993399:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391314.993407:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391314.993412:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790391314.993475:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993482:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391314.993509:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993517:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6200/0x2b1b7949f13e0e0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e14 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391314.993524:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1790391314.993533:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391314.993535:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391314.993536:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391314.993544:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186366080:0@lo:103: 00000100:00100000:2.0:1790391314.993615:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391314.993732:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186366080 00000100:00100000:0.0:1790391314.993739:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186366080 00010000:00010000:0.0:1790391314.993767:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0e14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e0d expref: 16 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391314.993818:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790391314.993826:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:3639:x1877361186366080:12345-0@lo:103: 00010000:00010000:0.0:1790391314.993840:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391314.993845:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0e14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e0d expref: 16 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993857:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e0d expref: 16 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993902:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f7600/0x2b1b7949f13e0e14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0e0d expref: 16 pid: 6507 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993919:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993927:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993944:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993951:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993959:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993966:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993982:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52813a3200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391314.993986:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.993995:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.994009:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391314.994019:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391314.994055:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3639:x1877361186366080:12345-0@lo:103: Request processed in 230us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391314.994062:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790391314.994130:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186366080:0@lo:103: 00010000:00010000:2.0:1790391314.994220:0:10325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.994229:0:10325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391314.994236:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f79 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391315.335730:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391315.335777:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391315.335818:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391315.335849:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391315.335915:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391315.335946:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169536000 00000100:00100000:1.0:1790391315.335955:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169536000 00000100:00100000:1.0:1790391315.336014:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169536128 00000100:00100000:1.0:1790391315.336017:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169536128 00000100:00100000:1.0:1790391315.336038:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:1.0:1790391315.336048:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169536000:12345-192.168.202.28@tcp:400: 00000100:00100000:1.0:1790391315.336142:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169536000:12345-192.168.202.28@tcp:400: Request processed in 94us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391315.336169:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:1.0:1790391315.336188:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:1.0:1790391315.336195:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169536128:12345-192.168.202.28@tcp:400: 00000100:00100000:1.0:1790391315.336222:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169536128:12345-192.168.202.28@tcp:400: Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391315.336229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00080000:1.0:1790391315.336247:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391315.336251:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391315.336560:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169535872 00000100:00100000:0.0:1790391315.336566:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169535872 00000100:00100000:0.0:1790391315.336612:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 199 00000100:00100000:0.0:1790391315.336620:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:2382:x1877361169535872:12345-192.168.202.28@tcp:400: 00000100:00100000:0.0:1790391315.336656:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:2382:x1877361169535872:12345-192.168.202.28@tcp:400: Request processed in 37us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391315.336662:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 199 00000100:00100000:3.0:1790391315.336941:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169536256 00000100:00100000:3.0:1790391315.336946:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169536256 00000100:00100000:3.0:1790391315.336977:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169536384 00000100:00100000:3.0:1790391315.336981:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169536384 00000100:00100000:3.0:1790391315.336998:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:3.0:1790391315.337003:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169536256:12345-192.168.202.28@tcp:400: 00000100:00100000:3.0:1790391315.337038:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169536256:12345-192.168.202.28@tcp:400: Request processed in 35us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391315.337045:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:3.0:1790391315.337057:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:3.0:1790391315.337064:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169536384:12345-192.168.202.28@tcp:400: 00000100:00100000:3.0:1790391315.337110:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169536384:12345-192.168.202.28@tcp:400: Request processed in 37us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391315.337117:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00080000:0.0:1790391315.337426:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391315.337430:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391315.400234:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391315.976237:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186366592:0@lo:400: 00000100:00100000:1.0:1790391315.976311:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391315.976379:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186367104:0@lo:400: 00000100:00100000:1.0:1790391315.976404:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391315.976426:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186367616:0@lo:400: 00000100:00100000:1.0:1790391315.976442:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391315.976461:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790391315.976465:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186366464:0@lo:400: 00000100:00100000:1.0:1790391315.976483:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391315.976496:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186366976:0@lo:400: 00000100:00100000:1.0:1790391315.976514:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391315.976526:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186367488:0@lo:400: 00000100:00100000:1.0:1790391315.976541:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391315.976564:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186366464 00000100:00100000:1.0:1790391315.976571:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186366464 00000100:00100000:1.0:1790391315.976614:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790391315.976622:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186366464:12345-0@lo:400: 00000100:00100000:1.0:1790391315.976681:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186366464:12345-0@lo:400: Request processed in 59us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391315.976689:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790391315.976717:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186367104 00000100:00100000:1.0:1790391315.976720:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186367104 00000100:00100000:1.0:1790391315.976749:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186367616 00000100:00100000:1.0:1790391315.976752:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186367616 00000100:00100000:1.0:1790391315.976785:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391315.976791:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186367104:12345-0@lo:400: 00000100:00100000:1.0:1790391315.976823:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186367104:12345-0@lo:400: Request processed in 33us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391315.976829:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391315.976840:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391315.976846:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186367616:12345-0@lo:400: 00000100:00100000:1.0:1790391315.976871:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186367616:12345-0@lo:400: Request processed in 25us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391315.976901:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391315.976919:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186366592 00000100:00100000:1.0:1790391315.976923:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186366592 00000100:00100000:1.0:1790391315.976944:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186366976 00000100:00100000:1.0:1790391315.976946:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186366976 00000100:00100000:1.0:1790391315.976959:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186367488 00000100:00100000:1.0:1790391315.976961:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186367488 00000100:00100000:1.0:1790391315.976974:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790391315.976979:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186366592:12345-0@lo:400: 00000100:00100000:1.0:1790391315.977009:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186366592:12345-0@lo:400: Request processed in 29us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391315.977015:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790391315.977036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790391315.977042:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186366976:12345-0@lo:400: 00000100:00100000:1.0:1790391315.977068:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186366976:12345-0@lo:400: Request processed in 27us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391315.977073:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790391315.977083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790391315.977088:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186367488:12345-0@lo:400: 00000100:00100000:1.0:1790391315.977124:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186367488:12345-0@lo:400: Request processed in 36us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391315.977130:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790391315.977167:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186366464:0@lo:400: 00010000:00080000:1.0:1790391315.977180:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7793480 x1877361186366976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391315.977190:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186366976:0@lo:400: 00010000:00080000:1.0:1790391315.977199:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7793800 x1877361186367488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391315.977207:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186367488:0@lo:400: 00000100:00100000:1.0:1790391315.977216:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186366592:0@lo:400: 00010000:00080000:1.0:1790391315.977225:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7790000 x1877361186367104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391315.977232:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186367104:0@lo:400: 00010000:00080000:1.0:1790391315.977240:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7793b80 x1877361186367616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391315.977247:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186367616:0@lo:400: 00000100:00100000:2.0:1790391315.977363:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186366336:0@lo:400: 00000100:00100000:2.0:1790391315.977396:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391315.977423:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186366848:0@lo:400: 00000100:00100000:2.0:1790391315.977452:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391315.977467:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186367360:0@lo:400: 00000100:00100000:2.0:1790391315.977482:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391315.977492:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1790391315.977496:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186366208:0@lo:400: 00000100:00100000:2.0:1790391315.977520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391315.977540:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186366720:0@lo:400: 00000100:00100000:2.0:1790391315.977557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391315.977571:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186367232:0@lo:400: 00000100:00100000:2.0:1790391315.977600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391315.977614:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186367744:0@lo:400: 00000100:00100000:2.0:1790391315.977629:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391315.977649:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186366208 00000100:00100000:2.0:1790391315.977653:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186366208 00000100:00100000:2.0:1790391315.977681:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790391315.977687:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3638:x1877361186366208:12345-0@lo:400: 00000100:00100000:2.0:1790391315.977719:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:3638:x1877361186366208:12345-0@lo:400: Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391315.977725:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790391315.977749:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186366720 00000100:00100000:2.0:1790391315.977752:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186366720 00000100:00100000:2.0:1790391315.977770:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790391315.977775:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186366720:12345-0@lo:400: 00000100:00100000:2.0:1790391315.977800:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186366720:12345-0@lo:400: Request processed in 25us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391315.977810:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790391315.977828:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186367232 00000100:00100000:2.0:1790391315.977830:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186367232 00000100:00100000:2.0:1790391315.977845:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186367744 00000100:00100000:2.0:1790391315.977847:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186367744 00000100:00100000:2.0:1790391315.977860:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790391315.977865:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186367232:12345-0@lo:400: 00000100:00100000:2.0:1790391315.977928:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186367232:12345-0@lo:400: Request processed in 62us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391315.977934:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790391315.977945:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790391315.977952:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186367744:12345-0@lo:400: 00000100:00100000:2.0:1790391315.977977:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186367744:12345-0@lo:400: Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391315.977983:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790391315.978001:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186366336 00000100:00100000:2.0:1790391315.978004:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186366336 00000100:00100000:2.0:1790391315.978018:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186366848 00000100:00100000:2.0:1790391315.978020:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186366848 00000100:00100000:2.0:1790391315.978030:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186367360 00000100:00100000:2.0:1790391315.978032:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186367360 00000100:00100000:2.0:1790391315.978044:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391315.978049:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186366336:12345-0@lo:400: 00000100:00100000:2.0:1790391315.978076:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186366336:12345-0@lo:400: Request processed in 27us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391315.978082:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391315.978093:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790391315.978110:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186366848:12345-0@lo:400: 00000100:00100000:2.0:1790391315.978144:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186366848:12345-0@lo:400: Request processed in 35us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391315.978151:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790391315.978162:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790391315.978167:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186367360:12345-0@lo:400: 00000100:00100000:2.0:1790391315.978192:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186367360:12345-0@lo:400: Request processed in 25us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391315.978198:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790391315.978234:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186366208:0@lo:400: 00000100:00100000:2.0:1790391315.978245:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186366720:0@lo:400: 00010000:00080000:2.0:1790391315.978255:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7790a80 x1877361186367232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391315.978264:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186367232:0@lo:400: 00010000:00080000:2.0:1790391315.978272:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7791180 x1877361186367744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391315.978279:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186367744:0@lo:400: 00000100:00100000:2.0:1790391315.978287:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186366336:0@lo:400: 00000100:00100000:2.0:1790391315.978295:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186366848:0@lo:400: 00000100:00100000:2.0:1790391315.978304:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186367360:0@lo:400: 00000100:00080000:0.0:1790391315.978804:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391315.978809:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391315.978821:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391315.978824:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391316.424973:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790391316.488113:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790391316.488122:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52bf9b4000 from 48 10000000:01000000:1.0:1790391316.488128:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391316.488179:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.488191:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.488202:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391316.488227:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186367872:0@lo:101: 00000100:00100000:1.0:1790391316.488297:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.488352:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254300 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.488415:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186367872 00000100:00100000:3.0:1790391316.488422:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186367872 00000100:00100000:3.0:1790391316.488473:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1790391316.488482:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+15:6509:x1877361186367872:12345-0@lo:101: 00010000:00010000:3.0:1790391316.488495:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391316.488509:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144600/0x2b1b7949f13e0f87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0f80 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.488531:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144600/0x2b1b7949f13e0f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0f80 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.488542:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144600/0x2b1b7949f13e0f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0f80 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.488552:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144600, rc 0) 00000100:00100000:3.0:1790391316.488608:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186367872:12345-0@lo:101: Request processed in 127us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.488614:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1790391316.488770:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391316.488782:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186368000:0@lo:13: 00000100:00100000:0.0:1790391316.488814:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.488951:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186367872:0@lo:101: 00010000:00010000:1.0:1790391316.488965:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.488975:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391316.489032:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186368128:0@lo:501: 00000100:00100000:1.0:1790391316.489057:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.489083:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254300 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.489144:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186368128 00000100:00100000:0.0:1790391316.489149:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186368128 00000100:00100000:0.0:1790391316.489183:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1790391316.489190:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186368128:12345-0@lo:501: 00000100:00100000:0.0:1790391316.489307:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186368128:12345-0@lo:501: Request processed in 116us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.489313:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790391316.489493:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186368128:0@lo:501: 00000100:00100000:1.0:1790391316.489518:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186368256:0@lo:503: 00000100:00100000:1.0:1790391316.489565:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.489592:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254300 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.489752:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186368256 00000100:00100000:0.0:1790391316.489766:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186368256 00000100:00100000:0.0:1790391316.489795:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790391316.489801:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186368256:12345-0@lo:503: 00000100:00100000:0.0:1790391316.489905:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186368256:12345-0@lo:503: Request processed in 103us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.489912:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1790391316.489997:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186368256:0@lo:503: 00000100:00100000:1.0:1790391316.490422:0:10342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10342:1877361186368384:0@lo:502: 00000100:00100000:1.0:1790391316.490458:0:10342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.490489:0:10342:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.490536:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186368384 00000100:00100000:0.0:1790391316.490541:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186368384 00000100:00100000:0.0:1790391316.490574:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1790391316.490580:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:10342:x1877361186368384:12345-0@lo:502: 00000100:00100000:0.0:1790391316.490668:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:10342:x1877361186368384:12345-0@lo:502: Request processed in 87us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.490675:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790391316.490798:0:10342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10342:1877361186368384:0@lo:502: 00000100:00100000:1.0:1790391316.490833:0:10342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10342:1877361186368512:0@lo:502: 00000100:00100000:1.0:1790391316.490862:0:10342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.490907:0:10342:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.491075:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186368512 00000100:00100000:0.0:1790391316.491085:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186368512 00000100:00100000:0.0:1790391316.491125:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1790391316.491132:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:10342:x1877361186368512:12345-0@lo:502: 00000100:00100000:0.0:1790391316.491206:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:10342:x1877361186368512:12345-0@lo:502: Request processed in 73us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.491213:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790391316.491325:0:10342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10342:1877361186368512:0@lo:502: 00000040:00080000:1.0:1790391316.491343:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:2.0:1790391316.491545:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186368000 00000100:00100000:2.0:1790391316.491551:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186368000 00000100:00100000:2.0:1790391316.491592:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391316.491599:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186368000:12345-0@lo:13: 00002000:00000024:2.0:1790391316.491628:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391316.491678:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186368000:12345-0@lo:13: Request processed in 80us (2862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391316.491684:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1790391316.491718:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a7b80 x1877361186368000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391316.491734:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186368000:0@lo:13: 00000100:00100000:1.0:1790391316.491952:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391316.491962:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186368640:0@lo:13: 00000100:00100000:1.0:1790391316.491989:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391316.492168:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186368640 00000100:00100000:2.0:1790391316.492173:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186368640 00000100:00100000:2.0:1790391316.492192:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790391316.492198:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186368640:12345-0@lo:13: 00002000:00000024:2.0:1790391316.492208:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391316.492245:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186368640:12345-0@lo:13: Request processed in 46us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391316.492251:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1790391316.492341:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7793b80 x1877361186368640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391316.492355:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186368640:0@lo:13: 00000020:01000000:0.0:1790391316.492406:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1790391316.492429:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790391316.492439:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391316.492450:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391316.492459:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1790391316.492462:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1790391316.492464:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790391316.492490:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391316.492497:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391316.492507:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391316.492520:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186368768:0@lo:101: 00000100:00100000:0.0:1790391316.492548:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391316.492581:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f22cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391316.492636:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186368768 00000100:00100000:2.0:1790391316.492640:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186368768 00000100:00100000:2.0:1790391316.492708:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790391316.492715:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+16:6509:x1877361186368768:12345-0@lo:101: 00010000:00010000:2.0:1790391316.492734:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391316.492748:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0f8e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.493915:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0f8e expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.493930:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0f8e expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.493950:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52813a3200, rc 0) 00000100:00100000:2.0:1790391316.494004:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186368768:12345-0@lo:101: Request processed in 1289us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391316.494011:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1790391316.494118:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186368768:0@lo:101: 00010000:00010000:0.0:1790391316.494141:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391316.494151:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391316.494216:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186368896:0@lo:501: 00000100:00100000:0.0:1790391316.494245:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.496835:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391316.499666:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f22cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.499973:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186368896 00000100:00100000:3.0:1790391316.499985:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186368896 00000100:00100000:3.0:1790391316.500040:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1790391316.500051:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186368896:12345-0@lo:501: 00000100:00100000:3.0:1790391316.500238:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186368896:12345-0@lo:501: Request processed in 189us (5991us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.500245:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1790391316.500419:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186368896:0@lo:501: 00000100:00100000:1.0:1790391316.500478:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186369024:0@lo:503: 00000100:00100000:1.0:1790391316.500523:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.500539:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.501917:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169536512 00000100:00100000:3.0:1790391316.501929:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169536512 00000100:00100000:3.0:1790391316.501966:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186369024 00000100:00100000:3.0:1790391316.501970:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186369024 00000100:00100000:3.0:1790391316.501989:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 208 00000100:00100000:3.0:1790391316.501998:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:6159:x1877361169536512:12345-192.168.202.28@tcp:101: 00010000:00010000:3.0:1790391316.502013:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391316.502030:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0f9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0020 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.502057:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0020 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.502069:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0020 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.502079:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144200, rc 0) 00000100:00100000:3.0:1790391316.502155:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6159:x1877361169536512:12345-192.168.202.28@tcp:101: Request processed in 157us (5328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.502162:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 208 00000100:00100000:3.0:1790391316.502190:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1790391316.502195:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186369024:12345-0@lo:503: 00000100:00100000:3.0:1790391316.502308:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186369024:12345-0@lo:503: Request processed in 112us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.502314:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1790391316.503445:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186369024:0@lo:503: 00000100:00100000:1.0:1790391316.503672:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10343:1877361186369152:0@lo:502: 00000100:00100000:1.0:1790391316.503732:0:10343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.505917:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.506285:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186369152 00000100:00100000:3.0:1790391316.506296:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186369152 00000100:00100000:3.0:1790391316.506341:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790391316.506349:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:10343:x1877361186369152:12345-0@lo:502: 00000100:00100000:3.0:1790391316.506524:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:10343:x1877361186369152:12345-0@lo:502: Request processed in 174us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.506531:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790391316.507044:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391316.507070:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169536640 00000100:00100000:3.0:1790391316.507075:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169536640 00000100:00100000:3.0:1790391316.507109:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 211 00000100:00100000:3.0:1790391316.507117:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6159:x1877361169536640:12345-192.168.202.28@tcp:501: 00000100:00100000:3.0:1790391316.507231:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6159:x1877361169536640:12345-192.168.202.28@tcp:501: Request processed in 113us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.507238:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 211 00000100:00100000:1.0:1790391316.507832:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10343:1877361186369152:0@lo:502: 00000020:01000000:1.0:1790391316.508050:0:10343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391316.508060:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391316.508062:0:10343:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790391316.508067:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790391316.508112:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10343:1877361186369280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.508163:0:10343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.508190:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.508250:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186369280 00000100:00100000:3.0:1790391316.508257:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186369280 00000100:00100000:3.0:1790391316.508283:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1790391316.508291:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:10343:x1877361186369280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.508389:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:10343:x1877361186369280:12345-0@lo:502:llog_process_th.0 Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.508396:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1790391316.509309:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10343:1877361186369280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391316.509342:0:10343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391316.509349:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391316.509351:0:10343:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790391316.509355:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1790391316.509533:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1790391316.509561:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790391316.509582:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.509594:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391316.509604:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790391316.509615:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52b77e2800 from 48 10000000:01000000:3.0:1790391316.509618:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391316.509652:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.509661:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.509681:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391316.509701:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186369408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.509750:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.509792:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282d27300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391316.509985:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186369408 00000100:00100000:1.0:1790391316.509991:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186369408 00000100:00100000:1.0:1790391316.510023:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1790391316.510029:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+17:6509:x1877361186369408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391316.510040:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391316.510052:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f6200/0x2b1b7949f13e0faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0fa3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.510071:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f6200/0x2b1b7949f13e0faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fa3 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.510081:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f6200/0x2b1b7949f13e0faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fa3 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.510113:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f6200, rc 0) 00000100:00100000:1.0:1790391316.510148:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186369408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.510154:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1790391316.510231:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186369408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391316.510245:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.510253:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391316.510305:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186369536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.510330:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.510388:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282d27300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391316.510447:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186369536 00000100:00100000:2.0:1790391316.510453:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186369536 00000100:00100000:0.0:1790391316.510526:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1790391316.510536:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186369536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391316.510664:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186369536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.510680:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1790391316.514747:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186369536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.514814:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186369664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.514911:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.518959:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282d27300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391316.519234:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186369664 00000100:00100000:1.0:1790391316.519245:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186369664 00000100:00100000:1.0:1790391316.519327:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391316.519396:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169536768 00000100:00100000:1.0:1790391316.519400:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169536768 00000100:00100000:1.0:1790391316.519419:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1790391316.519436:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186369664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.519584:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186369664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (4673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.519592:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1790391316.519634:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 216 00000100:00100000:1.0:1790391316.519641:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6159:x1877361169536768:12345-192.168.202.28@tcp:503: 00000100:00100000:1.0:1790391316.519834:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6159:x1877361169536768:12345-192.168.202.28@tcp:503: Request processed in 192us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.519841:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 216 00000100:00100000:3.0:1790391316.520796:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186369664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.526915:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10344:1877361186369792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.527015:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.527127:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282d27d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391316.527304:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186369792 00000100:00100000:1.0:1790391316.527313:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186369792 00000100:00100000:1.0:1790391316.527407:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1790391316.527417:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:10344:x1877361186369792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.527559:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:10344:x1877361186369792:12345-0@lo:502:llog_process_th.0 Request processed in 143us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.527577:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1790391316.527658:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10344:1877361186369792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.527718:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10344:1877361186369920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.527752:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.527904:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528968c480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391316.527990:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186369920 00000100:00100000:2.0:1790391316.527995:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186369920 00000100:00100000:2.0:1790391316.528018:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1790391316.528025:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:10344:x1877361186369920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391316.528119:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:10344:x1877361186369920:12345-0@lo:502:llog_process_th.0 Request processed in 94us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391316.528126:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1790391316.528201:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10344:1877361186369920:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790391316.528222:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790391316.528388:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1790391316.528411:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790391316.528422:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.528432:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391316.528442:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1790391316.528444:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1790391316.528447:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790391316.528471:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.528479:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.528495:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391316.528510:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391316.528540:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391316.528572:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.528616:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186370048 00000100:00100000:3.0:1790391316.528621:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186370048 00000100:00100000:3.0:1790391316.528641:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790391316.528647:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+18:6509:x1877361186370048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391316.528656:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391316.528667:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295145000/0x2b1b7949f13e0fb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0fb1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.528702:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295145000/0x2b1b7949f13e0fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fb1 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.528712:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295145000/0x2b1b7949f13e0fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fb1 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.528721:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145000, rc 0) 00000100:00100000:3.0:1790391316.528757:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186370048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.528770:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1790391316.528910:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391316.528923:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.528932:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391316.528980:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391316.529005:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391316.529026:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.529104:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186370176 00000100:00100000:3.0:1790391316.529109:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186370176 00000100:00100000:3.0:1790391316.529128:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1790391316.529133:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186370176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.529233:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186370176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.529240:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790391316.529302:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391316.529327:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391316.529357:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391316.529376:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.529414:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186370304 00000100:00100000:3.0:1790391316.529417:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186370304 00000100:00100000:3.0:1790391316.529432:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1790391316.529438:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186370304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.529512:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186370304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.529518:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1790391316.529590:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391316.529989:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10345:1877361186370432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391316.530024:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391316.530053:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.530112:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186370432 00000100:00100000:3.0:1790391316.530117:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186370432 00000100:00100000:3.0:1790391316.530136:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1790391316.530142:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:10345:x1877361186370432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.530222:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:10345:x1877361186370432:12345-0@lo:502:llog_process_th.0 Request processed in 79us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.530228:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1790391316.530301:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10345:1877361186370432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790391316.530324:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391316.530333:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391316.530335:0:10345:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790391316.530341:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790391316.530362:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10345:1877361186370560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391316.530397:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391316.530421:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.530464:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186370560 00000100:00100000:3.0:1790391316.530468:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186370560 00000100:00100000:3.0:1790391316.530488:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1790391316.530494:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:10345:x1877361186370560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.530572:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:10345:x1877361186370560:12345-0@lo:502:llog_process_th.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.530579:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1790391316.530653:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10345:1877361186370560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790391316.530744:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391316.530749:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391316.530750:0:10345:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790391316.530754:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1790391316.531028:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1790391316.531048:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790391316.531057:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.531067:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391316.531075:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790391316.531078:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52b5eaa800 from 48 10000000:01000000:3.0:1790391316.531081:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391316.531115:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.531124:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.531133:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391316.531149:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.531180:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.531238:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77db900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.531303:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186370688 00000100:00100000:0.0:1790391316.531309:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186370688 00000100:00100000:2.0:1790391316.531388:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790391316.531396:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:6509:x1877361186370688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391316.531404:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391316.531415:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52813a3e00/0x2b1b7949f13e0fc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0fbf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.531434:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52813a3e00/0x2b1b7949f13e0fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fbf expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.531443:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52813a3e00/0x2b1b7949f13e0fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fbf expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.531452:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52813a3e00, rc 0) 00000100:00100000:2.0:1790391316.531523:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186370688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391316.531540:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1790391316.531597:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391316.531610:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.531626:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391316.531751:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.531780:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.531838:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77db900 going to sleep for 11 seconds 00000100:00100000:1.0:1790391316.531870:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186370816 00000100:00100000:3.0:1790391316.532219:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391316.532404:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186370816 00000100:00100000:2.0:1790391316.532598:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169536896 00000100:00100000:2.0:1790391316.532602:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169536896 00000100:00100000:2.0:1790391316.532626:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790391316.532634:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186370816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391316.532903:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 226 00000100:00100000:0.0:1790391316.532913:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6640:x1877361169536896:12345-192.168.202.28@tcp:502: 00000100:00100000:0.0:1790391316.533020:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6640:x1877361169536896:12345-192.168.202.28@tcp:502: Request processed in 108us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.533028:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 226 00000100:00100000:2.0:1790391316.533364:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186370816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 729us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391316.533372:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790391316.533503:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.533550:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.533592:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.533628:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77db900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.533740:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186370944 00000100:00100000:0.0:1790391316.533747:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186370944 00000100:00100000:0.0:1790391316.533816:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790391316.533824:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186370944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391316.533941:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186370944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.533953:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790391316.534026:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186370944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.534226:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10346:1877361186371072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.534266:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.534609:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b77db0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391316.534649:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186371072 00000100:00100000:1.0:1790391316.534655:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186371072 00000100:00100000:1.0:1790391316.534692:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790391316.534701:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:10346:x1877361186371072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.534800:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:10346:x1877361186371072:12345-0@lo:502:llog_process_th.0 Request processed in 100us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.534806:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1790391316.534943:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10346:1877361186371072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.534988:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10346:1877361186371200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.535020:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.535036:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776c840 going to sleep for 11 seconds 00000100:00100000:1.0:1790391316.535107:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186371200 00000100:00100000:1.0:1790391316.535111:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186371200 00000100:00100000:1.0:1790391316.535128:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790391316.535133:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:10346:x1877361186371200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.535192:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:10346:x1877361186371200:12345-0@lo:502:llog_process_th.0 Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.535198:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790391316.535273:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10346:1877361186371200:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790391316.535291:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1790391316.535435:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1790391316.535456:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790391316.535466:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.535475:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391316.535485:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1790391316.535488:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1790391316.535498:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790391316.535523:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.535531:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.535541:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391316.535556:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186371328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.535584:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.535612:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.535653:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186371328 00000100:00100000:3.0:1790391316.535663:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186371328 00000100:00100000:3.0:1790391316.535693:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1790391316.535700:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186371328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391316.535708:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391316.535721:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0fd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0fcd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.535741:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fcd expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.535751:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fcd expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.535760:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144c00, rc 0) 00000100:00100000:3.0:1790391316.535798:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186371328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.535805:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1790391316.535963:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186371328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391316.535976:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.535984:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391316.536028:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186371456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.536051:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.536081:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.536350:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186371456 00000100:00100000:3.0:1790391316.536355:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186371456 00000100:00100000:3.0:1790391316.536374:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790391316.536380:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186371456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.536488:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186371456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.536494:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790391316.536601:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391316.536637:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186371456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.536665:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186371584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.536712:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.536730:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.536814:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169537024 00000100:00100000:3.0:1790391316.536818:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169537024 00000100:00100000:3.0:1790391316.536834:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186371584 00000100:00100000:3.0:1790391316.536836:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186371584 00000100:00100000:3.0:1790391316.536845:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 232 00000100:00100000:3.0:1790391316.536856:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6640:x1877361169537024:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790391316.536966:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6640:x1877361169537024:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 110us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.536973:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 232 00000100:00100000:3.0:1790391316.536990:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790391316.536996:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186371584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.537060:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186371584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.537067:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1790391316.537299:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186371584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.537814:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10347:1877361186371712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.537854:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.537908:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.537958:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186371712 00000100:00100000:3.0:1790391316.537963:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186371712 00000100:00100000:3.0:1790391316.537984:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790391316.537990:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:10347:x1877361186371712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.538078:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:10347:x1877361186371712:12345-0@lo:502:llog_process_th.0 Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.538085:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1790391316.538163:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10347:1877361186371712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391316.538186:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391316.538194:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391316.538197:0:10347:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790391316.538204:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790391316.538225:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10347:1877361186371840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.538259:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.538279:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.538316:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186371840 00000100:00100000:3.0:1790391316.538320:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186371840 00000100:00100000:3.0:1790391316.538338:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790391316.538343:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:10347:x1877361186371840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391316.538410:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:10347:x1877361186371840:12345-0@lo:502:llog_process_th.0 Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.538416:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790391316.538475:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10347:1877361186371840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391316.538493:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391316.538497:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391316.538498:0:10347:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790391316.538502:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1790391316.538978:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1790391316.538999:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790391316.539015:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.539025:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391316.539034:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790391316.539037:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5289da8000 from 48 10000000:01000000:3.0:1790391316.539039:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391316.539064:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.539072:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.539081:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391316.539123:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186371968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.539154:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.539176:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391316.539306:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186371968 00000100:00100000:1.0:1790391316.539311:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186371968 00000100:00100000:1.0:1790391316.539334:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790391316.539340:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186371968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391316.539350:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391316.539364:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0fe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0fdb expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.539388:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fdb expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.539407:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fdb expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.539416:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f7800, rc 0) 00000100:00100000:1.0:1790391316.539457:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186371968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.539463:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790391316.539529:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186371968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391316.539544:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.539553:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391316.539605:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186372096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.539654:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.539692:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391316.539833:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186372096 00000100:00100000:1.0:1790391316.539838:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186372096 00000100:00100000:1.0:1790391316.539857:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1790391316.539864:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186372096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.540000:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186372096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.540007:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790391316.540109:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186372096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.540137:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186372224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391316.540174:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391316.540192:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391316.540244:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186372224 00000100:00100000:1.0:1790391316.540248:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186372224 00000100:00100000:1.0:1790391316.540265:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1790391316.540271:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186372224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.540351:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186372224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.540357:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790391316.540426:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186372224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.541106:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10348:1877361186372352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.541153:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.541223:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391316.541258:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186372352 00000100:00100000:2.0:1790391316.541264:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186372352 00000100:00100000:2.0:1790391316.541340:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1790391316.541349:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:10348:x1877361186372352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391316.541455:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:10348:x1877361186372352:12345-0@lo:502:llog_process_th.0 Request processed in 106us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391316.541462:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790391316.541525:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10348:1877361186372352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.541568:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10348:1877361186372480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.541598:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.541821:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.542011:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186372480 00000100:00100000:0.0:1790391316.542017:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186372480 00000100:00100000:1.0:1790391316.542123:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1790391316.542131:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:10348:x1877361186372480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.542218:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:10348:x1877361186372480:12345-0@lo:502:llog_process_th.0 Request processed in 86us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.542225:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1790391316.542308:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10348:1877361186372480:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790391316.542331:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1790391316.542491:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1790391316.542514:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790391316.542523:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.542535:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391316.542543:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790391316.542546:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1790391316.542548:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790391316.542577:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.542584:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.542592:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391316.542615:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186372608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.542657:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391316.542843:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186372608 00000100:00100000:0.0:1790391316.542848:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186372608 00000100:00100000:0.0:1790391316.542870:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1790391316.542895:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186372608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391316.542903:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391316.542917:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0ff0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0fe9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391316.542938:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fe9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391316.542947:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0fe9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391316.542956:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee800, rc 0) 00000100:00100000:0.0:1790391316.543114:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186372608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.543120:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790391316.543180:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254840 going to sleep for 11 seconds 00000100:00100000:1.0:1790391316.543196:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186372608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391316.543209:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.543218:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391316.543269:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186372736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.543295:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.543351:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.543405:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186372736 00000100:00100000:3.0:1790391316.543410:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186372736 00000100:00100000:2.0:1790391316.543457:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790391316.543468:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186372736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391316.543587:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186372736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391316.543594:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790391316.543658:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186372736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.543762:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186372864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.543803:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.543825:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.543872:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186372864 00000100:00100000:0.0:1790391316.543910:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186372864 00000100:00100000:0.0:1790391316.543938:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790391316.543945:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186372864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391316.544037:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186372864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.544044:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790391316.544180:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186372864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391316.544475:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10349:1877361186372992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.544511:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.544540:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.544578:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186372992 00000100:00100000:0.0:1790391316.544582:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186372992 00000100:00100000:0.0:1790391316.544611:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790391316.544618:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:10349:x1877361186372992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391316.544829:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:10349:x1877361186372992:12345-0@lo:502:llog_process_th.0 Request processed in 211us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.544836:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1790391316.545026:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10349:1877361186372992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391316.545050:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391316.545064:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391316.545066:0:10349:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790391316.545073:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790391316.545104:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10349:1877361186373120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391316.545141:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391316.545195:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.545223:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186373120 00000100:00100000:0.0:1790391316.545228:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186373120 00000100:00100000:0.0:1790391316.545290:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790391316.545297:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:10349:x1877361186373120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391316.545377:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:10349:x1877361186373120:12345-0@lo:502:llog_process_th.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391316.545383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790391316.545439:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10349:1877361186373120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391316.545457:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391316.545461:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391316.545463:0:10349:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790391316.545466:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1790391316.545620:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1790391316.545644:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790391316.545654:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.545666:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391316.545693:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790391316.545696:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e52ae8c99c0 from 1 10000000:01000000:2.0:1790391316.545699:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790391316.545725:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52813a2800/0x2b1b7949f13e0ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.545733:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52813a2800/0x2b1b7949f13e0ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.545741:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52813a2800/0x2b1b7949f13e0ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391316.545755:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186373248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391316.545785:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391316.546083:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391316.546159:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186373248 00000100:00100000:3.0:1790391316.546166:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186373248 00000100:00100000:3.0:1790391316.546193:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1790391316.546200:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186373248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391316.546210:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391316.546223:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0ffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e0ff7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.546245:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ff7 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.546256:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ff7 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391316.546265:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144e00, rc 0) 00000100:00100000:3.0:1790391316.546371:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186373248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391316.546377:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1790391316.546459:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186373248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391316.546474:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52813a2800/0x2b1b7949f13e0ff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ffe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.546482:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52813a2800/0x2b1b7949f13e0ff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0ffe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391316.546534:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186373376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391316.546560:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391316.546612:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391316.546645:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186373376 00000100:00100000:0.0:1790391316.546649:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186373376 00000100:00100000:0.0:1790391316.546761:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1790391316.546771:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186373376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391316.546844:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186373376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (283us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391316.546851:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1790391316.546916:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186373376:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1790391316.546937:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790391316.546949:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52813a2800/0x2b1b7949f13e0ff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ffe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391316.546957:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52813a2800/0x2b1b7949f13e0ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ffe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391316.548391:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391316.548468:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169537152 00000100:00100000:1.0:1790391316.548477:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169537152 00000100:00100000:1.0:1790391316.548529:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 248 00000100:00100000:1.0:1790391316.548539:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6159:x1877361169537152:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391316.548554:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391316.548573:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f7c00/0x2b1b7949f13e1005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0027 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.548598:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f7c00/0x2b1b7949f13e1005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0027 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.548610:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f7c00/0x2b1b7949f13e1005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0027 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391316.548618:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f7c00, rc 0) 00000100:00100000:1.0:1790391316.548675:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6159:x1877361169537152:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 Request processed in 137us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391316.548683:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 248 00000100:00100000:1.0:1790391316.552306:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391316.552401:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169537280 00000100:00100000:0.0:1790391316.552423:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169537280 00000100:00100000:0.0:1790391316.552514:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 249 00000100:00100000:0.0:1790391316.552525:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6159:x1877361169537280:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391316.552677:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6159:x1877361169537280:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 Request processed in 146us (372us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391316.552686:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 249 00010000:00010000:0.0:1790391317.451175:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391317.512091:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391317.512155:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186373504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391317.512288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391317.512541:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186373504 00000100:00100000:3.0:1790391317.512550:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186373504 00000100:00100000:3.0:1790391317.512650:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391317.512671:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186373504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391317.512701:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391317.512758:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186373504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391317.512765:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1790391317.512923:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790391317.516260:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229df80 x1877361186373504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391317.516290:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186373504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391317.516727:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186373632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391317.516794:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186373760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391317.516799:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391317.516848:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391317.516918:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186373760 00000100:00100000:0.0:1790391317.516921:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186373632 00000100:00100000:3.0:1790391317.516925:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186373760 00000100:00100000:0.0:1790391317.516928:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186373632 00000100:00100000:3.0:1790391317.516981:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790391317.516982:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790391317.516996:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186373760:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391317.516997:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186373632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391317.517020:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1790391317.517030:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391317.517065:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186373632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391317.517073:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790391317.517092:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186373760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391317.517100:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1790391317.517104:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790391317.517131:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77ead80 x1877361186373632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391317.517144:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186373760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391317.517163:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186373632:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1790391318.214563:0:10386:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb0d14bd0 20000000:00000080:3.0:1790391318.214585:0:10386:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e51831ebc00 uarg=0000000000000000 20000000:01000000:3.0:1790391318.214641:0:10386:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790391318.214647:0:10386:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790391318.214651:0:10386:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790391318.215529:0:10387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1790391318.215817:0:10386:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1790391318.224438:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1790391318.224478:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1790391318.224513:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1790391318.224530:0:10386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790391318.224551:0:10386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.224571:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5295145c00/0x2b1b7949f13e0ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0ca1 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.224579:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e0cb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0caf expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.224587:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0d0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0d03 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.224594:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e0e29 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.224603:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0f48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe8 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.224611:0:10386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.224662:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe8 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.224682:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0f48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe8 expref: 9 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391318.224699:0:10386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1877361186373888:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391318.224827:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0e29 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.224842:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0e30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e29 expref: 23 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391318.224853:0:10386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1877361186374016:0@lo:104: 00000100:00100000:3.0:1790391318.225181:0:10386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391318.225223:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0d03 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.225232:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0d0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d03 expref: 23 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391318.225241:0:10386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1877361186374144:0@lo:104: 00000100:00100000:3.0:1790391318.225269:0:10386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391318.225292:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e0cb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0caf expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.225299:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e0cb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0caf expref: 23 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391318.225306:0:10386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1877361186374272:0@lo:104: 00010000:00010000:3.0:1790391318.225328:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5295145c00/0x2b1b7949f13e0ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e0ca1 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.225335:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5295145c00/0x2b1b7949f13e0ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ca1 expref: 23 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391318.225342:0:10386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1877361186374400:0@lo:104: 00000100:00100000:3.0:1790391318.225358:0:10386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967ae540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391318.225967:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790391318.225988:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391318.226001:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391318.226010:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186374016 00000100:00100000:1.0:1790391318.226016:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186374016 00000100:00100000:1.0:1790391318.226052:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186374144 00000100:00100000:1.0:1790391318.226056:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186374144 00000100:00100000:1.0:1790391318.226066:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186374272 00000100:00100000:1.0:1790391318.226069:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186374272 00000100:00100000:1.0:1790391318.226088:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186374400 00000100:00100000:1.0:1790391318.226091:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186374400 00000100:00100000:1.0:1790391318.226105:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391318.226113:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+6:10386:x1877361186374016:12345-0@lo:104: 00010000:00010000:1.0:1790391318.226127:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226187:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790391318.226193:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+6:10386:x1877361186374016:12345-0@lo:104: Request processed in 81us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391318.226200:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391318.226216:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790391318.226222:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518332b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:10386:x1877361186374144:12345-0@lo:104: 00010000:00010000:1.0:1790391318.226230:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226276:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790391318.226282:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518332b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:10386:x1877361186374144:12345-0@lo:104: Request processed in 60us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391318.226288:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790391318.226315:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391318.226321:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:10386:x1877361186374272:12345-0@lo:104: 00010000:00010000:1.0:1790391318.226329:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226367:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790391318.226373:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:10386:x1877361186374272:12345-0@lo:104: Request processed in 52us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391318.226379:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391318.226391:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391318.226397:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10386:x1877361186374400:12345-0@lo:104: 00010000:00010000:1.0:1790391318.226404:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeec00/0x2b1b7949f13e0ca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226430:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790391318.226435:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:10386:x1877361186374400:12345-0@lo:104: Request processed in 39us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391318.226440:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1790391318.226457:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790391318.226462:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226480:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f6a00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391318.226484:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226493:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391318.226499:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391318.226504:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391318.226544:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226551:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391318.226572:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226578:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f6a00/0x2b1b7949f13e0e29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0e30 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226592:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790391318.226595:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226601:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145a00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391318.226603:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226619:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391318.226625:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391318.226630:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391318.226642:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226647:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391318.226653:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226785:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295145a00/0x2b1b7949f13e0d03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0d0a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226955:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391318.226960:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226965:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391318.226968:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.226975:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391318.226981:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391318.226992:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391318.227007:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227012:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391318.227030:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227036:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295144400/0x2b1b7949f13e0caf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0cb6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227045:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391318.227047:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeec00/0x2b1b7949f13e0ca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227053:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eeec00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391318.227056:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeec00/0x2b1b7949f13e0ca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227063:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeec00/0x2b1b7949f13e0ca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391318.227069:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeec00/0x2b1b7949f13e0ca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391318.227085:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391318.227098:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeec00/0x2b1b7949f13e0ca1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227104:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391318.227116:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeec00/0x2b1b7949f13e0ca1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227122:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeec00/0x2b1b7949f13e0ca1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e0ca8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227134:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391318.227136:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391318.227138:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391318.227145:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391318.227157:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186374528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391318.227205:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391318.227230:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391318.227236:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186374656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391318.227255:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391318.227284:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186374784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391318.227305:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391318.227321:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391318.227325:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186374912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391318.227346:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391318.227368:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186374528 00000100:00100000:1.0:1790391318.227374:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186374528 00010000:00010000:1.0:1790391318.227396:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0e30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e29 expref: 24 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391318.227413:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186374656 00000100:00100000:1.0:1790391318.227416:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186374656 00010000:00010000:1.0:1790391318.227425:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0d0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d03 expref: 25 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391318.227447:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186374784 00000100:00100000:1.0:1790391318.227450:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186374784 00010000:00010000:1.0:1790391318.227461:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e0cb6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0caf expref: 26 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391318.227470:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186374912 00000100:00100000:1.0:1790391318.227472:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186374912 00010000:00010000:1.0:1790391318.227483:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5295145c00/0x2b1b7949f13e0ca8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ca1 expref: 27 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391318.227493:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391318.227500:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+27:3639:x1877361186374528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391318.227510:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391318.227515:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0e30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e29 expref: 27 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227524:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0e30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0e29 expref: 27 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227540:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391318.227569:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+27:3639:x1877361186374528:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391318.227575:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391318.227589:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391318.227595:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+26:3639:x1877361186374656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391318.227603:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391318.227607:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0d0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d03 expref: 26 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227626:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0d0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0d03 expref: 26 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.227635:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391318.228171:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566de00/0x2b1b7949f13e0e30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0e29 expref: 26 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391318.228185:0:10386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1877361186374016:0@lo:104: 00010000:00010000:3.0:1790391318.228196:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e0d0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0d03 expref: 25 pid: 6505 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391318.228203:0:10386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1877361186374144:0@lo:104: 00000100:00100000:3.0:1790391318.228212:0:10386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1877361186374272:0@lo:104: 00000100:00100000:3.0:1790391318.228218:0:10386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1877361186374400:0@lo:104: 00000100:00100000:0.0:1790391318.229007:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790391318.229019:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1790391318.229043:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790391318.229054:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790391318.229065:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186374784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391318.229100:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391318.229107:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e0cb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0caf expref: 24 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.229118:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e0cb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0caf expref: 24 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.229132:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144a00/0x2b1b7949f13e0cb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0caf expref: 24 pid: 6507 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.229144:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391318.229197:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:3637:x1877361186374784:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391318.229203:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790391318.229222:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790391318.229228:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790391318.229234:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:3637:x1877361186374912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391318.229242:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391318.229247:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5295145c00/0x2b1b7949f13e0ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ca1 expref: 22 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.229254:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5295145c00/0x2b1b7949f13e0ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e0ca1 expref: 22 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.229263:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295145c00/0x2b1b7949f13e0ca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e0ca1 expref: 22 pid: 6506 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.229272:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391318.229292:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:3637:x1877361186374912:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391318.229304:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391318.230106:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+26:3639:x1877361186374656:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391318.230119:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391318.230184:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186374912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391318.230194:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186374784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391318.230225:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186374656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391318.230235:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186374528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391318.240303:0:10386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1877361186373888:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391318.240345:0:10386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391318.242564:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391318.242698:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169537408 00000100:00100000:0.0:1790391318.242717:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169537408 00010000:00010000:0.0:1790391318.242761:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0f48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe8 expref: 10 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391318.242798:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:0.0:1790391318.242808:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2383:x1877361169537408:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391318.242822:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391318.242828:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0f48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe8 expref: 10 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.242843:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe8 expref: 10 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.242864:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e0f48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe8 expref: 10 pid: 6506 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.242922:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.242931:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.242948:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.242956:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.242981:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.242988:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.242995:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391318.243000:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.243008:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.243024:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391318.243035:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391318.243111:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:2383:x1877361169537408:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 302us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391318.243119:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 39 00010000:00010000:1.0:1790391318.243739:0:10386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.243751:0:10386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.243757:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e100c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391318.443835:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790391318.443844:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52bf9b4000 from 4 10000000:01000000:2.0:1790391318.443848:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391318.443914:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.443927:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.443938:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391318.443964:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.444030:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.444083:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391318.444387:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186375040 00000100:00100000:3.0:1790391318.444396:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186375040 00000100:00100000:3.0:1790391318.444451:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1790391318.444461:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186375040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391318.444474:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391318.444488:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e101a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e1013 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.444511:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e101a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e1013 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.444522:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e101a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e1013 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391318.444531:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031400, rc 0) 00000100:00100000:3.0:1790391318.444590:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186375040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391318.444597:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1790391318.445428:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391318.445447:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.445468:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391318.445543:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.445579:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.445620:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da480 going to sleep for 11 seconds 00000100:00100000:3.0:1790391318.446822:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186375168 00000100:00100000:3.0:1790391318.446831:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186375168 00000100:00100000:3.0:1790391318.446872:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1790391318.446896:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186375168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391318.447028:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186375168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391318.447035:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1790391318.448437:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.448491:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.448549:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.448581:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.448596:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186375296 00000100:00100000:2.0:1790391318.448601:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186375296 00000100:00100000:2.0:1790391318.448637:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790391318.448644:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186375296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.450558:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186375296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1906us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.450571:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790391318.450647:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.451981:0:10400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10400:1877361186375424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391318.452055:0:10400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.452104:0:10400:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da600 going to sleep for 11 seconds 00000100:00100000:3.0:1790391318.452430:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186375424 00000100:00100000:3.0:1790391318.452437:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186375424 00000100:00100000:3.0:1790391318.452482:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790391318.452491:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:10400:x1877361186375424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391318.452609:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:10400:x1877361186375424:12345-0@lo:502:llog_process_th.0 Request processed in 118us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391318.452616:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1790391318.456700:0:10400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10400:1877361186375424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391318.456871:0:10400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391318.456905:0:10400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391318.456908:0:10400:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790391318.456917:0:10400:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52bf9b4000 00000020:00000080:1.0:1790391318.456920:0:10400:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790391318.457185:0:10400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7792680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10400:1877361186375552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391318.457261:0:10400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391318.457365:0:10400:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183880a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.458835:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186375552 00000100:00100000:2.0:1790391318.458848:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186375552 00000100:00100000:2.0:1790391318.458916:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790391318.458933:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:10400:x1877361186375552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391318.459100:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:10400:x1877361186375552:12345-0@lo:502:llog_process_th.0 Request processed in 169us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.459109:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1790391318.460868:0:10400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7792680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10400:1877361186375552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790391318.460928:0:10400:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391318.460935:0:10400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391318.460938:0:10400:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790391318.460942:0:10400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790391318.463438:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790391318.463474:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391318.463486:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.463499:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391318.463511:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790391318.463514:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b77e2800 from 4 10000000:01000000:2.0:1790391318.463516:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391318.463559:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.463567:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.463579:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391318.463603:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.463673:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.463725:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.463747:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186375680 00000100:00100000:2.0:1790391318.463752:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186375680 00000100:00100000:2.0:1790391318.463808:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1790391318.463817:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186375680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391318.463829:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391318.463842:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e1028 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e1021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.463865:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e1028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e1021 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.463902:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e1028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e1021 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.463911:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e529566c400, rc 0) 00000100:00100000:2.0:1790391318.463950:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186375680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.463956:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1790391318.464002:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391318.464014:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.464023:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391318.464102:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.464126:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.464139:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.464151:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186375808 00000100:00100000:2.0:1790391318.464154:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186375808 00000100:00100000:2.0:1790391318.464179:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1790391318.464185:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186375808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.464306:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186375808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.464313:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1790391318.464344:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.464368:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.464403:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.464415:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.464426:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186375936 00000100:00100000:2.0:1790391318.464429:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186375936 00000100:00100000:2.0:1790391318.464448:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1790391318.464454:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186375936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.464526:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186375936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.464533:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1790391318.464572:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186375936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.464793:0:10402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10402:1877361186376064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391318.464828:0:10402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.464848:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186376064 00000100:00100000:2.0:1790391318.464852:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186376064 00000100:00100000:2.0:1790391318.464896:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1790391318.464904:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:10402:x1877361186376064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391318.464969:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:10402:x1877361186376064:12345-0@lo:502:llog_process_th.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.464982:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1790391318.465013:0:10402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f22480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.465027:0:10402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10402:1877361186376064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790391318.465048:0:10402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391318.465057:0:10402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391318.465059:0:10402:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790391318.465066:0:10402:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52b77e2800 00000020:00000080:2.0:1790391318.465069:0:10402:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790391318.465156:0:10402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10402:1877361186376192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391318.465190:0:10402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.465212:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186376192 00000100:00100000:2.0:1790391318.465216:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186376192 00000100:00100000:2.0:1790391318.465238:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790391318.465244:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:10402:x1877361186376192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391318.465303:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:10402:x1877361186376192:12345-0@lo:502:llog_process_th.0 Request processed in 59us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.465309:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790391318.465340:0:10402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.465352:0:10402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10402:1877361186376192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790391318.465370:0:10402:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391318.465374:0:10402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391318.465376:0:10402:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790391318.465379:0:10402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790391318.465433:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790391318.465449:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391318.465457:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.465472:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391318.465483:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790391318.465485:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b5eaa800 from 4 10000000:01000000:2.0:1790391318.465488:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391318.465508:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.465515:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.465523:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391318.465535:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186376320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.465562:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.465578:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f22480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.465592:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186376320 00000100:00100000:2.0:1790391318.465595:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186376320 00000100:00100000:2.0:1790391318.465617:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1790391318.465624:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5289dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186376320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391318.465631:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391318.465642:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e529566c800/0x2b1b7949f13e1036 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e102f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.465660:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e529566c800/0x2b1b7949f13e1036 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e102f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.465682:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e529566c800/0x2b1b7949f13e1036 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e102f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.465690:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e529566c800, rc 0) 00000100:00100000:2.0:1790391318.465720:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5289dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186376320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.465727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1790391318.465758:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186376320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391318.465769:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.465777:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391318.465819:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186376448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.465847:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.465860:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f22480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.465871:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186376448 00000100:00100000:2.0:1790391318.465898:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186376448 00000100:00100000:2.0:1790391318.465924:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790391318.465931:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186376448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.466010:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186376448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.466016:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1790391318.466044:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186376448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.466091:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186376576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.466130:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.466146:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f22480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.466159:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186376576 00000100:00100000:2.0:1790391318.466163:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186376576 00000100:00100000:2.0:1790391318.466186:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790391318.466193:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186376576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.466261:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186376576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.466268:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790391318.466308:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186376576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391318.467447:0:10403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10403:1877361186376704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391318.467499:0:10403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391318.467532:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186376704 00000100:00100000:0.0:1790391318.467537:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186376704 00000100:00100000:0.0:1790391318.467566:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790391318.467574:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:10403:x1877361186376704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391318.467661:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:10403:x1877361186376704:12345-0@lo:502:llog_process_th.0 Request processed in 88us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391318.467677:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790391318.467717:0:10403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518225e240 going to sleep for 11 seconds 00000100:00100000:0.0:1790391318.467733:0:10403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10403:1877361186376704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391318.467756:0:10403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391318.467765:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391318.467767:0:10403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790391318.467773:0:10403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52b5eaa800 00000020:00000080:0.0:1790391318.467775:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790391318.467844:0:10403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10403:1877361186376832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391318.467901:0:10403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391318.467914:0:10403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518225e240 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.468857:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186376832 00000100:00100000:2.0:1790391318.468868:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186376832 00000100:00100000:2.0:1790391318.468933:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790391318.468942:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:10403:x1877361186376832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391318.469068:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:10403:x1877361186376832:12345-0@lo:502:llog_process_th.0 Request processed in 126us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.469096:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790391318.469220:0:10403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10403:1877361186376832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391318.469249:0:10403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391318.469257:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391318.469259:0:10403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790391318.469263:0:10403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790391318.469454:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790391318.469475:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391318.469487:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.469497:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391318.469519:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790391318.469522:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5289da8000 from 4 10000000:01000000:2.0:1790391318.469524:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391318.469555:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.469563:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.469571:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391318.469588:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186376960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.469620:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.469654:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529823f300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391318.469683:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186376960 00000100:00100000:1.0:1790391318.469689:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186376960 00000100:00100000:1.0:1790391318.469734:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790391318.469742:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186376960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391318.469751:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391318.469763:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f6a00/0x2b1b7949f13e1044 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e103d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.469856:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f6a00/0x2b1b7949f13e1044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e103d expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.469868:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f6a00/0x2b1b7949f13e1044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e103d expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391318.470499:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f6a00, rc 0) 00000100:00100000:1.0:1790391318.470566:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186376960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 824us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391318.470574:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790391318.471011:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186376960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391318.471028:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.471038:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391318.471120:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186377088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.471156:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391318.471187:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529823f300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.471209:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186377088 00000100:00100000:2.0:1790391318.471213:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186377088 00000100:00100000:2.0:1790391318.471261:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790391318.471269:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186377088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391318.471405:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186377088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.471412:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790391318.471639:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186377088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391318.471673:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7792680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186377216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391318.471732:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391318.471753:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183880240 going to sleep for 11 seconds 00000100:00100000:0.0:1790391318.471792:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186377216 00000100:00100000:0.0:1790391318.471798:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186377216 00000100:00100000:0.0:1790391318.471838:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790391318.471846:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186377216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391318.471965:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186377216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391318.471971:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790391318.472129:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7792680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186377216:0@lo:503:ll_cfg_requeue.0 00010000:00010000:0.0:1790391318.472189:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391318.473525:0:10405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10405:1877361186377344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391318.473592:0:10405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391318.473641:0:10405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967ae600 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.473696:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186377344 00000100:00100000:2.0:1790391318.473702:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186377344 00000100:00100000:2.0:1790391318.473757:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1790391318.473766:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:10405:x1877361186377344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391318.473867:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:10405:x1877361186377344:12345-0@lo:502:llog_process_th.0 Request processed in 100us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391318.473898:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790391318.474062:0:10405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10405:1877361186377344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391318.474100:0:10405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391318.474110:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391318.474113:0:10405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790391318.474120:0:10405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5289da8000 00000020:00000080:3.0:1790391318.474123:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790391318.474571:0:10405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10405:1877361186377472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391318.474602:0:10405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391318.474653:0:10405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967ae600 going to sleep for 11 seconds 00000100:00100000:2.0:1790391318.475047:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186377472 00000100:00100000:2.0:1790391318.475054:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186377472 00000100:00100000:3.0:1790391318.475189:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790391318.475197:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:10405:x1877361186377472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391318.475431:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:10405:x1877361186377472:12345-0@lo:502:llog_process_th.0 Request processed in 234us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391318.475439:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790391318.475513:0:10405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:10405:1877361186377472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391318.475538:0:10405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391318.475544:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391318.475546:0:10405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790391318.475550:0:10405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790391318.475690:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790391318.475721:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391318.475733:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391318.475744:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391319.436298:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391319.443200:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169537536 00000100:00100000:3.0:1790391319.443216:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169537536 00000100:00100000:0.0:1790391319.444511:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 270 00000100:00100000:0.0:1790391319.444524:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:6159:x1877361169537536:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391319.444551:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391319.444571:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e104b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b002e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391319.444597:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e104b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b002e expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391319.444607:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e104b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b002e expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391319.444616:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee600, rc 0) 00000100:00100000:0.0:1790391319.444690:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6159:x1877361169537536:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 Request processed in 168us (8401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391319.444697:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 270 00000100:00100000:1.0:1790391319.452438:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391319.452515:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169537664 00000100:00100000:3.0:1790391319.452525:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169537664 00000100:00100000:3.0:1790391319.452585:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 271 00000100:00100000:3.0:1790391319.452595:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6159:x1877361169537664:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391319.452746:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6159:x1877361169537664:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 Request processed in 151us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391319.452754:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 271 00000100:00100000:3.0:1790391319.456549:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391319.456625:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169537792 00000100:00100000:2.0:1790391319.456636:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169537792 00000100:00100000:2.0:1790391319.456686:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 272 00000100:00100000:2.0:1790391319.456696:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6159:x1877361169537792:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391319.456833:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6159:x1877361169537792:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 Request processed in 138us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391319.456846:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 272 00000100:00100000:3.0:1790391319.470078:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391319.470172:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169537920 00000100:00100000:1.0:1790391319.470184:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169537920 00000100:00100000:1.0:1790391319.470231:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 273 00000100:00100000:1.0:1790391319.470240:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6698:x1877361169537920:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391319.470390:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6698:x1877361169537920:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 150us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391319.470397:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 273 00000100:00100000:0.0:1790391319.482710:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391319.482841:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169538048 00000100:00100000:3.0:1790391319.482852:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169538048 00000100:00100000:3.0:1790391319.482937:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 274 00000100:00100000:3.0:1790391319.482948:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6698:x1877361169538048:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790391319.483091:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:6698:x1877361169538048:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 144us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391319.483098:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 274 00010000:00010000:2.0:1790391319.496905:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391319.564247:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186377600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391319.564320:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391319.564394:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186377600 00000100:00100000:1.0:1790391319.564402:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186377600 00000100:00100000:1.0:1790391319.564446:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790391319.564455:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186377600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391319.564489:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790391319.564533:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186377600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391319.564542:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790391319.564587:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186377600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391320.462834:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391320.462871:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391320.462920:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391320.462939:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391320.462992:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391320.467985:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169538304 00000100:00100000:2.0:1790391320.468001:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169538304 00000100:00100000:2.0:1790391320.468070:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169538432 00000100:00100000:2.0:1790391320.468074:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169538432 00000100:00100000:2.0:1790391320.468101:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:2.0:1790391320.468112:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169538304:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391320.468190:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169538304:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 80us (5365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391320.468197:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:2.0:1790391320.468215:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:2.0:1790391320.468221:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169538432:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391320.468246:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169538432:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 25us (5306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391320.468252:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:2.0:1790391320.468270:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169538560 00000100:00100000:2.0:1790391320.468273:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169538560 00000100:00100000:2.0:1790391320.468297:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169538688 00000100:00100000:2.0:1790391320.468299:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169538688 00000100:00100000:2.0:1790391320.468318:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:2.0:1790391320.468325:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169538560:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391320.468351:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169538560:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 28us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391320.468357:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:2.0:1790391320.468377:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:2.0:1790391320.468382:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169538688:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391320.468406:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169538688:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (5414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391320.468412:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:2.0:1790391320.468430:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169538176 00000100:00100000:2.0:1790391320.468434:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169538176 00000100:00100000:2.0:1790391320.468461:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 275 00000100:00100000:2.0:1790391320.468467:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2383:x1877361169538176:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391320.468487:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2383:x1877361169538176:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 21us (5568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391320.468492:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 275 00000100:00080000:2.0:1790391320.468528:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391320.468532:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391320.468534:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391320.468536:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790391320.520087:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391321.096418:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186377728:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.096502:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391321.096563:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186378240:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.096624:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391321.096650:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391321.096656:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186378112:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.096684:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391321.096719:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186377984:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.096742:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391321.096761:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790391321.096767:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186377856:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.096786:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391321.096802:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186378368:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.096821:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391321.096849:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186378112 00000100:00100000:1.0:1790391321.096856:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186378112 00000100:00100000:1.0:1790391321.096914:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186377856 00000100:00100000:1.0:1790391321.096916:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186377856 00000100:00100000:1.0:1790391321.096927:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186378368 00000100:00100000:1.0:1790391321.096929:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186378368 00000100:00100000:1.0:1790391321.096951:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790391321.096959:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186378112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.097005:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186378112:12345-0@lo:400:kworker.0 Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391321.097012:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790391321.097026:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790391321.097030:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186377856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.097068:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186377856:12345-0@lo:400:kworker.0 Request processed in 37us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391321.097074:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790391321.097092:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790391321.097097:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186378368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.097122:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186378368:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391321.097128:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790391321.097143:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186378240 00000100:00100000:1.0:1790391321.097146:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186378240 00000100:00100000:1.0:1790391321.097166:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186377984 00000100:00100000:1.0:1790391321.097168:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186377984 00000100:00100000:1.0:1790391321.097179:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790391321.097185:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186378240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.097215:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186378240:12345-0@lo:400:kworker.0 Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391321.097220:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790391321.097230:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790391321.097235:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186377984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.097257:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186377984:12345-0@lo:400:kworker.0 Request processed in 22us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391321.097262:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1790391321.097304:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391321.097333:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186377856:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.097343:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186378368:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.097351:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186377984:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.097379:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186378112:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.097385:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186378240:0@lo:400:kworker.0 00000100:00100000:2.0:1790391321.098151:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186378752:0@lo:400:kworker.0 00000100:00100000:2.0:1790391321.098199:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391321.098222:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186379264:0@lo:400:kworker.0 00000100:00100000:2.0:1790391321.098242:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391321.098260:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790391321.098264:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186378624:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.098391:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186378496:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.098418:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391321.098436:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186379008:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.098455:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391321.098471:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391321.098476:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186378880:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.098496:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391321.098520:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186378496 00000100:00100000:2.0:1790391321.100350:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391321.100416:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186379136:0@lo:400:kworker.0 00000100:00100000:2.0:1790391321.100475:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391321.100646:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186377728 00000100:00100000:0.0:1790391321.100654:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186377728 00000100:00100000:0.0:1790391321.100707:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790391321.100717:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186377728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.100808:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186378496 00000100:00100000:1.0:1790391321.100849:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186379008 00000100:00100000:1.0:1790391321.100853:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186379008 00000100:00100000:1.0:1790391321.100868:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186378880 00000100:00100000:1.0:1790391321.100870:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186378880 00000100:00100000:1.0:1790391321.100902:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790391321.100908:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186378496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.100951:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186378496:12345-0@lo:400:kworker.0 Request processed in 43us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391321.100958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790391321.100974:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790391321.100979:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186379008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.101006:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186379008:12345-0@lo:400:kworker.0 Request processed in 27us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391321.101011:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790391321.101020:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790391321.101026:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186378880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.101059:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186378880:12345-0@lo:400:kworker.0 Request processed in 22us (2551us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391321.101072:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1790391321.101093:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391321.101097:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391321.101135:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186378880:0@lo:400:kworker.0 00010000:00080000:1.0:1790391321.101151:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820ae680 x1877361186378496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391321.101161:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186378496:0@lo:400:kworker.0 00010000:00080000:1.0:1790391321.101171:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820af480 x1877361186379008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391321.101179:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186379008:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.101825:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186378752 00000100:00100000:1.0:1790391321.101832:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186378752 00000100:00100000:1.0:1790391321.101861:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186379264 00000100:00100000:1.0:1790391321.101864:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186379264 00000100:00100000:1.0:1790391321.101893:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186378624 00000100:00100000:1.0:1790391321.101896:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186378624 00000100:00100000:1.0:1790391321.101908:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186379136 00000100:00100000:1.0:1790391321.101910:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186379136 00000100:00100000:1.0:1790391321.101922:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790391321.101928:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186378752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391321.102029:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790391321.102039:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186379264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391321.112006:0:9796:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1790391321.112031:0:9796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1790391321.112162:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1790391321.112181:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391321.112196:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186378624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391321.112485:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186377728:12345-0@lo:400:kworker.0 Request processed in 11767us (15981us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391321.112495:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:0.0:1790391321.112579:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391321.112597:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391321.112812:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186378752:12345-0@lo:400:kworker.0 Request processed in 10882us (14610us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391321.112821:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790391321.112838:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1790391321.112845:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790391321.112853:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186379136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.112917:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186379136:12345-0@lo:400:kworker.0 Request processed in 65us (12441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391321.112924:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790391321.117767:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186379264:12345-0@lo:400:kworker.0 Request processed in 15717us (19509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391321.117787:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790391321.121458:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186378624:12345-0@lo:400:kworker.0 Request processed in 9257us (23164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391321.121474:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1790391321.125111:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820ac000 x1877361186378624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391321.125131:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186378624:0@lo:400:kworker.0 00010000:00080000:1.0:1790391321.125285:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820ad880 x1877361186379136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391321.125296:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186379136:0@lo:400:kworker.0 00010000:00080000:1.0:1790391321.125312:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820aca80 x1877361186378752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391321.125321:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186378752:0@lo:400:kworker.0 00010000:00080000:1.0:1790391321.125332:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820af100 x1877361186379264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391321.125340:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186379264:0@lo:400:kworker.0 00000100:00100000:1.0:1790391321.125350:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186377728:0@lo:400:kworker.0 00010000:00010000:2.0:1790391321.553208:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391321.612638:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186379392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391321.612710:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391321.612734:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186379392 00000100:00100000:0.0:1790391321.612742:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186379392 00000100:00100000:0.0:1790391321.612788:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790391321.612793:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1790391321.612797:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186379392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391321.612802:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1790391321.612824:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391321.612930:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186379520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391321.612932:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186379392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391321.612939:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790391321.612957:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391321.612974:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186379520 00000100:00100000:0.0:1790391321.612978:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186379520 00000100:00100000:0.0:1790391321.612994:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790391321.612998:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186379520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391321.613008:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391321.613037:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186379520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391321.613054:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1790391321.613172:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820ad500 x1877361186379520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391321.613190:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186379520:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1790391321.614661:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77e8000 x1877361186379392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391321.614682:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186379392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790391322.569944:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391322.632430:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186379648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391322.632504:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391322.632580:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186379648 00000100:00100000:0.0:1790391322.632588:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186379648 00000100:00100000:0.0:1790391322.632635:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790391322.632645:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186379648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391322.632687:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391322.632734:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186379648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391322.632753:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1790391322.632797:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77eb480 x1877361186379648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391322.632816:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186379648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391322.634676:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186379776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391322.634739:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391322.634951:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186379776 00000100:00100000:2.0:1790391322.634959:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186379776 00000100:00100000:2.0:1790391322.635013:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790391322.635022:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186379776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391322.635066:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790391322.635123:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186379776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391322.635130:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790391322.637501:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186379776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391322.637682:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186379904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391322.637751:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391322.637809:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186379904 00000100:00100000:2.0:1790391322.637815:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186379904 00000100:00100000:2.0:1790391322.637860:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790391322.637870:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186379904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391322.637905:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391322.637948:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186379904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391322.637955:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1790391322.637984:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a7b80 x1877361186379904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391322.637998:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186379904:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790391323.592225:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391324.319290:0:10689:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1790391324.616161:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391324.680218:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391324.680243:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186380032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391324.680313:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391324.680393:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186380032 00000100:00100000:1.0:1790391324.680416:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186380032 00000100:00100000:1.0:1790391324.680467:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790391324.680476:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186380032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391324.680510:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790391324.680557:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186380032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391324.680564:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790391324.680616:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186380032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391325.581795:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391325.589349:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169538816 00000100:00100000:0.0:1790391325.589366:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169538816 00000100:00100000:0.0:1790391325.589679:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 277 00000100:00100000:0.0:1790391325.589691:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2383:x1877361169538816:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391325.595418:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2383:x1877361169538816:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 5576us (13480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391325.595441:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 277 00000100:00100000:1.0:1790391325.598855:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391325.599978:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391325.600905:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391325.600950:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391325.600994:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169538944 00000100:00100000:1.0:1790391325.601003:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169538944 00000100:00100000:1.0:1790391325.601083:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169539072 00000100:00100000:1.0:1790391325.601087:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169539072 00000100:00100000:1.0:1790391325.601113:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 75 00000100:00100000:1.0:1790391325.601123:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169538944:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391325.601873:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 76 00000100:00100000:0.0:1790391325.601920:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169539072:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391325.602003:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169539072:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 90us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391325.602024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 76 00000100:00080000:0.0:1790391325.602052:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391325.602057:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391325.602209:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169539200 00000100:00100000:0.0:1790391325.602215:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169539200 00000100:00100000:0.0:1790391325.602266:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169539328 00000100:00100000:0.0:1790391325.602270:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169539328 00000100:00100000:0.0:1790391325.602945:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:0.0:1790391325.602956:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169539200:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391325.602988:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169539200:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 35us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391325.602994:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:0.0:1790391325.603021:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:0.0:1790391325.603029:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169539328:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391325.603051:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169539328:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391325.603058:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00080000:0.0:1790391325.603082:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391325.603085:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391325.603220:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169538944:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 1400us (3676us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391325.603232:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 75 00010000:00010000:2.0:1790391325.642234:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391326.216602:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186380288:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.216683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391326.216735:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186380800:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.216757:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391326.216780:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186381312:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.216818:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391326.216843:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1790391326.216849:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186380160:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.216899:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391326.216923:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186380672:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.216947:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391326.216965:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186381184:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.216992:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391326.217020:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186381696:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.217040:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391326.217064:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186380416:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.217084:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391326.217107:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186380928:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.217140:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391326.217144:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186380544:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.217158:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186381440:0@lo:400:kworker.0 00000100:00100000:3.0:1790391326.217169:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391326.217181:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186381056:0@lo:400:kworker.0 00000100:00100000:2.0:1790391326.218433:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186380288 00000100:00100000:2.0:1790391326.218445:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186380288 00000100:00100000:2.0:1790391326.218484:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186380800 00000100:00100000:2.0:1790391326.218488:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186380800 00000100:00100000:2.0:1790391326.218515:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186381312 00000100:00100000:2.0:1790391326.218518:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186381312 00000100:00100000:2.0:1790391326.218529:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186380928 00000100:00100000:2.0:1790391326.218531:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186380928 00000100:00100000:2.0:1790391326.218544:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186380544 00000100:00100000:2.0:1790391326.218546:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186380544 00000100:00100000:2.0:1790391326.218570:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790391326.218579:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186380288:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790391326.218640:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391326.218645:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391326.218731:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391326.218775:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186381440 00000100:00100000:1.0:1790391326.218778:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186381440 00000100:00100000:1.0:1790391326.218809:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790391326.218815:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186380800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.218865:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186380800:12345-0@lo:400:kworker.0 Request processed in 50us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391326.218873:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790391326.218908:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790391326.218914:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186381312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.218952:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186381312:12345-0@lo:400:kworker.0 Request processed in 39us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391326.218958:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790391326.218970:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790391326.218976:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186380928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.219016:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186380928:12345-0@lo:400:kworker.0 Request processed in 41us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391326.219021:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790391326.220638:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391326.220685:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186381568:0@lo:400:kworker.0 00000100:00100000:3.0:1790391326.220713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391326.220754:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186381184 00000100:00100000:3.0:1790391326.220759:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186381184 00000100:00100000:3.0:1790391326.220793:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186381696 00000100:00100000:3.0:1790391326.220795:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186381696 00000100:00100000:3.0:1790391326.220805:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186381056 00000100:00100000:3.0:1790391326.220807:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186381056 00000100:00100000:3.0:1790391326.220817:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186381568 00000100:00100000:3.0:1790391326.220819:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186381568 00000100:00100000:3.0:1790391326.220829:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391326.220836:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186381184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391326.220900:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186381184:12345-0@lo:400:kworker.0 Request processed in 64us (3907us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391326.220907:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391326.221224:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391326.221230:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186381696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391326.221320:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186381696:12345-0@lo:400:kworker.0 Request processed in 90us (4278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391326.221435:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391326.221447:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391326.221453:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186381056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391326.221484:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186381056:12345-0@lo:400:kworker.0 Request processed in 31us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391326.221502:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391326.221512:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391326.221517:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186381568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391326.221538:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186381568:12345-0@lo:400:kworker.0 Request processed in 22us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391326.221544:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1790391326.221578:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382ce00 x1877361186381056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391326.221592:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186381056:0@lo:400:kworker.0 00010000:00080000:3.0:1790391326.221602:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382ed80 x1877361186381568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391326.221610:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186381568:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222067:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790391326.222078:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186380544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222126:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186380544:12345-0@lo:400:kworker.0 Request processed in 51us (4956us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391326.222132:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790391326.222146:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790391326.222151:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186380544:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222153:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186381440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222181:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186381440:12345-0@lo:400:kworker.0 Request processed in 29us (3450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391326.222187:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790391326.222207:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186380160 00000100:00100000:1.0:1790391326.222211:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186380160 00000100:00100000:1.0:1790391326.222238:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1790391326.222244:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186380160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222273:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186380160:12345-0@lo:400:kworker.0 Request processed in 30us (5396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391326.222279:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1790391326.222314:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186380672 00000100:00100000:1.0:1790391326.222318:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186380672 00000100:00100000:1.0:1790391326.222344:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186380416 00000100:00100000:1.0:1790391326.222347:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186380416 00000100:00100000:1.0:1790391326.222361:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790391326.222367:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186380672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222399:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186380672:12345-0@lo:400:kworker.0 Request processed in 32us (5451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391326.222405:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790391326.222416:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1790391326.222475:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391326.222480:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391326.222483:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391326.222504:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186380416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222534:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186380416:12345-0@lo:400:kworker.0 Request processed in 113us (5448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391326.222540:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790391326.222567:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186380160:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222574:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186380672:0@lo:400:kworker.0 00010000:00080000:1.0:1790391326.222582:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382dc00 x1877361186381184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391326.222588:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186381184:0@lo:400:kworker.0 00010000:00080000:1.0:1790391326.222594:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382e680 x1877361186381696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391326.222599:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186381696:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222607:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186380800:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222613:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186381312:0@lo:400:kworker.0 00000100:00100000:1.0:1790391326.222641:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186380416:0@lo:400:kworker.0 00010000:00080000:1.0:1790391326.222648:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382ea00 x1877361186380928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391326.222654:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186380928:0@lo:400:kworker.0 00010000:00080000:1.0:1790391326.222660:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382c700 x1877361186381440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391326.222664:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186381440:0@lo:400:kworker.0 00000100:00100000:2.0:1790391326.227077:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186380288:12345-0@lo:400:kworker.0 Request processed in 8488us (10383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391326.227093:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790391326.227191:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186380288:0@lo:400:kworker.0 00010000:00010000:0.0:1790391326.666255:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391326.728410:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391326.728438:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186381824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391326.728516:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391326.728715:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186381824 00000100:00100000:0.0:1790391326.728726:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186381824 00000100:00100000:0.0:1790391326.728782:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790391326.728792:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186381824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391326.728819:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391326.728896:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186381824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391326.728917:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1790391326.729060:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828700 x1877361186381824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391326.729081:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186381824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391326.730118:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391326.730134:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186381952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391326.730181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391326.730234:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186381952 00000100:00100000:0.0:1790391326.730240:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186381952 00000100:00100000:0.0:1790391326.730284:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790391326.730292:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186381952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391326.730307:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391326.730346:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186381952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391326.730352:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1790391326.730429:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382ad80 x1877361186381952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391326.730445:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186381952:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790391327.690871:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391327.752069:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790391327.752092:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186382080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391327.752167:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391327.752239:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186382208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391327.752279:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391327.752339:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186382208 00000100:00100000:3.0:1790391327.752346:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186382208 00000100:00100000:0.0:1790391327.752901:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186382080 00000100:00100000:0.0:1790391327.752908:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186382080 00000100:00100000:0.0:1790391327.752948:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790391327.752959:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186382080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391327.753007:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391327.753068:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186382080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391327.753075:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391327.753239:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391327.753248:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186382208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391327.753273:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790391327.753325:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186382208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391327.753331:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1790391327.753374:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77eaa00 x1877361186382080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391327.754447:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186382080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391327.754770:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186382208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391327.755672:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186382336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391327.755735:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391327.755835:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186382336 00000100:00100000:1.0:1790391327.755842:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186382336 00000100:00100000:1.0:1790391327.755904:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790391327.755915:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186382336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790391327.755938:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391327.756206:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186382336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 293us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391327.756214:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1790391327.756270:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51832ce680 x1877361186382336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391327.756296:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186382336:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790391328.729201:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391329.736768:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391329.812958:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391329.812991:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186382464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391329.813078:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391329.813177:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186382464 00000100:00100000:3.0:1790391329.813185:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186382464 00000100:00100000:3.0:1790391329.813234:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790391329.813243:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186382464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391329.813276:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790391329.813326:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186382464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391329.813333:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790391329.813382:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186382464:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1790391330.327396:0:10933:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing yml_node 00000100:00100000:0.0:1790391330.705678:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391330.705728:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391330.705768:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391330.705802:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169539712 00000100:00100000:0.0:1790391330.705812:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169539712 00000100:00100000:0.0:1790391330.705870:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169539584 00000100:00100000:0.0:1790391330.705895:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169539584 00000100:00100000:0.0:1790391330.705923:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 83 00000100:00100000:0.0:1790391330.705933:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169539712:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391330.706024:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169539712:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391330.706033:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 83 00000100:00100000:0.0:1790391330.706050:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 84 00000100:00100000:0.0:1790391330.706057:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169539584:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391330.706082:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169539584:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391330.706088:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 84 00000100:00080000:0.0:1790391330.706108:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391330.706112:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391330.709593:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169539456 00000100:00100000:1.0:1790391330.709625:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169539456 00000100:00100000:1.0:1790391330.709693:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 279 00000100:00100000:1.0:1790391330.709703:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2384:x1877361169539456:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391330.709780:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2384:x1877361169539456:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 78us (4111us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391330.709788:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 279 00000100:00100000:0.0:1790391330.719461:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391330.719505:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391330.719621:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169539840 00000100:00100000:1.0:1790391330.719630:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169539840 00000100:00100000:1.0:1790391330.719691:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169539968 00000100:00100000:1.0:1790391330.719694:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169539968 00000100:00100000:1.0:1790391330.719715:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:1.0:1790391330.719724:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2380:x1877361169539840:12345-192.168.202.28@tcp:9:kworker.0 00000020:00000080:1.0:1790391330.719756:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0f64 00000100:00080000:1.0:1790391330.719765:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e5183373000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391330.719806:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1790391330.719977:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+2:2380:x1877361169539840:12345-192.168.202.28@tcp:9:kworker.0 Request processed in 253us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391330.719985:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:1.0:1790391330.720000:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:1.0:1790391330.720007:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2380:x1877361169539968:12345-192.168.202.28@tcp:9:kworker.0 00000020:00000080:1.0:1790391330.720018:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0f5d 00000100:00080000:1.0:1790391330.720024:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e5182263000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391330.720045:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1790391330.720110:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+2:2380:x1877361169539968:12345-192.168.202.28@tcp:9:kworker.0 Request processed in 103us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391330.720115:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00010000:00010000:1.0:1790391330.720190:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391330.720289:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391330.720306:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391330.720313:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391330.761955:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391331.342397:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186382848:0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.342472:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391331.342528:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186383360:0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.342555:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391331.342573:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186383872:0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.342595:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391331.342619:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790391331.342625:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186382976:0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.342649:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391331.342666:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186383488:0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.342688:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391331.342712:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186384000:0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.342733:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391331.342767:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186382848 00000100:00100000:3.0:1790391331.342774:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186382848 00000100:00100000:3.0:1790391331.342821:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391331.342830:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186382848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.342903:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186382848:12345-0@lo:400:kworker.0 Request processed in 74us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391331.342911:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391331.342934:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186383360 00000100:00100000:3.0:1790391331.342939:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186383360 00000100:00100000:3.0:1790391331.342990:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186383872 00000100:00100000:3.0:1790391331.342994:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186383872 00000100:00100000:3.0:1790391331.343009:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186382976 00000100:00100000:3.0:1790391331.343012:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186382976 00000100:00100000:3.0:1790391331.343038:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790391331.343044:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186383360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.343077:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186383360:12345-0@lo:400:kworker.0 Request processed in 33us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391331.343083:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790391331.343096:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790391331.343102:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186383872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.343128:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186383872:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391331.343134:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790391331.343145:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790391331.343151:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186382976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.343177:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186382976:12345-0@lo:400:kworker.0 Request processed in 26us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391331.343183:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790391331.343206:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186383488 00000100:00100000:3.0:1790391331.343210:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186383488 00000100:00100000:3.0:1790391331.343249:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186384000 00000100:00100000:3.0:1790391331.343252:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186384000 00000100:00100000:3.0:1790391331.343270:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790391331.343276:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186383488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.343307:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186383488:12345-0@lo:400:kworker.0 Request processed in 31us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391331.343313:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790391331.343324:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790391331.343330:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186384000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.343369:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186384000:12345-0@lo:400:kworker.0 Request processed in 39us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391331.343374:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1790391331.343396:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391331.343400:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391331.343402:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391331.343437:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186382976:0@lo:400:kworker.0 00010000:00080000:3.0:1790391331.343450:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518206e680 x1877361186383488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391331.343460:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186383488:0@lo:400:kworker.0 00010000:00080000:3.0:1790391331.343468:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831ded80 x1877361186384000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391331.343475:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186384000:0@lo:400:kworker.0 00000100:00100000:3.0:1790391331.343483:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186382848:0@lo:400:kworker.0 00010000:00080000:3.0:1790391331.343490:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51832cdf80 x1877361186383360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391331.343498:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186383360:0@lo:400:kworker.0 00010000:00080000:3.0:1790391331.343505:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e529233a680 x1877361186383872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391331.343512:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186383872:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.343930:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186382720:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.343978:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391331.344002:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186383232:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344020:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391331.344043:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186383744:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344061:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391331.344080:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1790391331.344087:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186382592:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344112:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391331.344146:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186383104:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344168:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391331.344185:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186383616:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344206:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391331.344224:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186384128:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344243:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391331.344270:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186382592 00000100:00100000:2.0:1790391331.344275:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186382592 00000100:00100000:2.0:1790391331.344310:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1790391331.344317:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186382592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344352:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186382592:12345-0@lo:400:kworker.0 Request processed in 36us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391331.344359:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1790391331.344388:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186383104 00000100:00100000:2.0:1790391331.344391:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186383104 00000100:00100000:2.0:1790391331.344413:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790391331.344418:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186383104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344446:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186383104:12345-0@lo:400:kworker.0 Request processed in 28us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391331.344452:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790391331.344467:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186383616 00000100:00100000:2.0:1790391331.344470:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186383616 00000100:00100000:2.0:1790391331.344496:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186384128 00000100:00100000:2.0:1790391331.344499:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186384128 00000100:00100000:2.0:1790391331.344516:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391331.344522:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344551:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186383616:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391331.344564:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391331.344576:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391331.344581:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186384128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344608:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186384128:12345-0@lo:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391331.344613:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391331.344636:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186382720 00000100:00100000:2.0:1790391331.344639:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186382720 00000100:00100000:2.0:1790391331.344660:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186383232 00000100:00100000:2.0:1790391331.344663:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186383232 00000100:00100000:2.0:1790391331.344674:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186383744 00000100:00100000:2.0:1790391331.344676:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186383744 00000100:00100000:2.0:1790391331.344689:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790391331.344694:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186382720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344722:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186382720:12345-0@lo:400:kworker.0 Request processed in 28us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391331.344728:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790391331.344739:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790391331.344744:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186383232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344770:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186383232:12345-0@lo:400:kworker.0 Request processed in 27us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391331.344775:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790391331.344785:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790391331.344791:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186383744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344815:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186383744:12345-0@lo:400:kworker.0 Request processed in 24us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391331.344829:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1790391331.344856:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391331.344859:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391331.344861:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391331.344915:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186382592:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344926:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186383104:0@lo:400:kworker.0 00010000:00080000:2.0:1790391331.344936:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518206c700 x1877361186383616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391331.344944:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186383616:0@lo:400:kworker.0 00010000:00080000:2.0:1790391331.344963:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831df800 x1877361186384128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391331.344972:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186384128:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344982:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186382720:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344990:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186383232:0@lo:400:kworker.0 00000100:00100000:2.0:1790391331.344999:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186383744:0@lo:400:kworker.0 00010000:00010000:0.0:1790391331.784683:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391331.848744:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186384256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391331.848823:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391331.848996:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186384256 00000100:00100000:0.0:1790391331.849006:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186384256 00000100:00100000:0.0:1790391331.849061:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790391331.849071:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186384256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391331.849112:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391331.849164:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186384256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391331.849171:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1790391331.849253:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382ad80 x1877361186384256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391331.849271:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186384256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391331.849634:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391331.849644:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186384384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391331.849671:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391331.849765:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186384384 00000100:00100000:1.0:1790391331.849770:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186384384 00000100:00100000:1.0:1790391331.849799:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790391331.849805:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186384384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391331.849815:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391331.849852:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186384384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391331.849858:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1790391331.849916:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829f80 x1877361186384384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391331.849929:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186384384:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790391332.810629:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391332.872228:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391332.872253:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186384512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391332.872344:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391332.872690:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186384640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391332.872723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391332.872764:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186384512 00000100:00100000:0.0:1790391332.872772:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186384512 00000100:00100000:0.0:1790391332.872832:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186384640 00000100:00100000:0.0:1790391332.872836:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186384640 00000100:00100000:0.0:1790391332.872852:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790391332.872860:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186384512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391332.872910:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391332.872966:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186384512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391332.872975:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790391332.872992:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790391332.872999:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186384640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391332.873009:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391332.873038:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186384640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391332.873045:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1790391332.873078:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77ead80 x1877361186384640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391332.873111:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186384640:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1790391332.873864:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5181cb8000 x1877361186384512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391332.873896:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186384512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391332.874198:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391332.874210:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186384768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391332.874257:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391332.881598:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186384768 00000100:00100000:2.0:1790391332.881614:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186384768 00000100:00100000:2.0:1790391332.882642:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790391332.882732:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186384768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391332.882772:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790391332.883115:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186384768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 460us (8855us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391332.883123:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790391332.888048:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186384768:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790391333.843750:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790391334.240382:0:11116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.4 00010000:00010000:2.0:1790391334.864394:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391334.922685:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391334.922709:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186384896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391334.922784:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391334.923026:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186384896 00000100:00100000:1.0:1790391334.923035:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186384896 00000100:00100000:1.0:1790391334.923095:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790391334.923106:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186384896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391334.923142:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790391334.923193:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186384896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391334.923199:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790391334.923278:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186384896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391335.824058:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391335.824119:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391335.824159:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391335.824254:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169540224 00000100:00100000:0.0:1790391335.824254:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169540352 00000100:00100000:2.0:1790391335.824263:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169540224 00000100:00100000:0.0:1790391335.824263:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169540352 00000100:00100000:3.0:1790391335.824321:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169540096 00000100:00100000:3.0:1790391335.824325:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169540096 00000100:00100000:0.0:1790391335.824334:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 91 00000100:00100000:0.0:1790391335.824343:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169540352:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391335.824351:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 281 00000100:00100000:3.0:1790391335.824356:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2382:x1877361169540096:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391335.824457:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2382:x1877361169540096:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 99us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391335.824464:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 281 00000100:00100000:2.0:1790391335.825010:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 92 00000100:00100000:2.0:1790391335.825018:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169540224:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391335.825528:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169540352:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 1183us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391335.825538:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 91 00000100:00080000:1.0:1790391335.827805:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391335.827818:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391335.829361:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169540224:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 4330us (5187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391335.829377:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 92 00010000:00010000:0.0:1790391335.880291:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391336.456259:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186385408:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.456329:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.456397:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186385920:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.456427:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.456452:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186386432:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.456473:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.456640:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1790391336.456649:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186385024:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.456682:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.456706:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186385536:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.456731:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.456773:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186386048:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.456797:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.456816:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186386560:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.456837:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.456914:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186385152:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.456940:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.456959:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186385664:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.456979:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.456995:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186386176:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.457017:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.457036:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790391336.457042:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186385280:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.457063:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.457079:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186385792:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.457099:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.457109:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186386304:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.457128:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391336.457155:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186385920 00000100:00100000:0.0:1790391336.457163:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186385920 00000100:00100000:0.0:1790391336.457214:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186386432 00000100:00100000:0.0:1790391336.457217:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186386432 00000100:00100000:0.0:1790391336.457230:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186386048 00000100:00100000:0.0:1790391336.457233:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186386048 00000100:00100000:0.0:1790391336.457244:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186386560 00000100:00100000:0.0:1790391336.457246:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186386560 00000100:00100000:0.0:1790391336.457260:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790391336.457269:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186385920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.457331:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186385920:12345-0@lo:400:kworker.0 Request processed in 62us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391336.457338:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790391336.457355:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790391336.457362:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186386432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391336.457629:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186385408 00000100:00100000:1.0:1790391336.457634:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186385408 00000100:00100000:1.0:1790391336.457657:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186385152 00000100:00100000:1.0:1790391336.457661:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186385152 00000100:00100000:1.0:1790391336.457671:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186385664 00000100:00100000:1.0:1790391336.457674:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186385664 00000100:00100000:1.0:1790391336.457687:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186386176 00000100:00100000:1.0:1790391336.457696:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186386176 00000100:00100000:1.0:1790391336.457711:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186385792 00000100:00100000:1.0:1790391336.457713:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186385792 00000100:00100000:1.0:1790391336.457724:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186386304 00000100:00100000:1.0:1790391336.457727:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186386304 00000100:00100000:1.0:1790391336.457740:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790391336.457747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186385408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391336.458962:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790391336.458977:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186385152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391336.460792:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186385408:12345-0@lo:400:kworker.0 Request processed in 3040us (4457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391336.460807:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790391336.460843:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790391336.460854:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186385664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391336.460954:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186385664:12345-0@lo:400:kworker.0 Request processed in 104us (3972us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391336.460961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790391336.460975:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790391336.460982:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186386176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391336.461013:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186386176:12345-0@lo:400:kworker.0 Request processed in 32us (3995us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391336.461019:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790391336.461031:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790391336.461038:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186385792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391336.461067:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186385792:12345-0@lo:400:kworker.0 Request processed in 30us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391336.461073:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790391336.461084:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790391336.461091:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186386304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391336.461132:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186386304:12345-0@lo:400:kworker.0 Request processed in 41us (4002us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391336.461138:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790391336.461161:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186385536 00000100:00100000:1.0:1790391336.461169:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186385536 00000100:00100000:1.0:1790391336.461204:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186385280 00000100:00100000:1.0:1790391336.461208:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186385280 00000100:00100000:1.0:1790391336.461223:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790391336.461229:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186385536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391336.461263:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186385536:12345-0@lo:400:kworker.0 Request processed in 34us (4531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391336.461269:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790391336.461279:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790391336.461285:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186385280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391336.461312:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186385280:12345-0@lo:400:kworker.0 Request processed in 27us (4248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391336.461317:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1790391336.461333:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391336.461338:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391336.461341:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391336.461344:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391336.461709:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186385280:0@lo:400:kworker.0 00010000:00080000:2.0:1790391336.461730:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829180 x1877361186385792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391336.461740:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186385792:0@lo:400:kworker.0 00010000:00080000:2.0:1790391336.461755:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829f80 x1877361186386304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391336.461782:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186386304:0@lo:400:kworker.0 00000100:00100000:2.0:1790391336.461797:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186385664:0@lo:400:kworker.0 00000100:00100000:2.0:1790391336.461807:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186386176:0@lo:400:kworker.0 00000100:00100000:2.0:1790391336.462011:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391336.462022:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186386048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391336.462075:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186386048:12345-0@lo:400:kworker.0 Request processed in 56us (5277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391336.462080:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391336.462098:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391336.462104:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186386560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391336.462133:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186386560:12345-0@lo:400:kworker.0 Request processed in 30us (5295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391336.462138:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790391336.468673:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186386432:12345-0@lo:400:kworker.0 Request processed in 11300us (12186us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391336.468690:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790391336.468847:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186385536:0@lo:400:kworker.0 00010000:00080000:0.0:1790391336.469310:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828e00 x1877361186386048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391336.469322:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186386048:0@lo:400:kworker.0 00010000:00080000:0.0:1790391336.469336:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828700 x1877361186386560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391336.469344:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186386560:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.469357:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186385408:0@lo:400:kworker.0 00010000:00080000:0.0:1790391336.469367:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382aa00 x1877361186385920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391336.469373:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186385920:0@lo:400:kworker.0 00000100:00100000:3.0:1790391336.469621:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186385024 00000100:00100000:3.0:1790391336.469629:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186385024 00000100:00100000:3.0:1790391336.469683:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1790391336.469692:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186385024:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1790391336.470135:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382ad80 x1877361186386432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391336.470147:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186386432:0@lo:400:kworker.0 00000100:00100000:0.0:1790391336.470214:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186385024:0@lo:400:kworker.0 00000100:00100000:3.0:1790391336.471016:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186385024:12345-0@lo:400:kworker.0 Request processed in 71us (13079us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391336.471031:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1790391336.474340:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186385152:12345-0@lo:400:kworker.0 Request processed in 15356us (17387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391336.474356:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790391336.475109:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186385152:0@lo:400:kworker.0 00000001:00100000:2.0:1790391336.475928:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:2.0:1790391336.475936:0:8421:0:(genops.c:885:class_export_put()) final put ffff9e5183373800/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000001:00100000:3.0:1790391336.476026:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:3.0:1790391336.476030:0:9505:0:(genops.c:885:class_export_put()) final put ffff9e5182264000/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:0.0:1790391336.476380:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183373800/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d for lustre-OST0000 00000020:00000080:0.0:1790391336.476579:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182264000/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d for lustre-OST0001 00000020:00000080:0.0:1790391336.476599:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5183373000 for lustre-OST0000 00000020:00000080:0.0:1790391336.476604:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182263000 for lustre-OST0001 00000001:02000400:2.0:1790391336.818432:0:11214:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.4 00010000:00010000:2.0:1790391336.906267:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391336.969194:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391336.969219:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186386688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391336.969291:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391336.969356:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186386688 00000100:00100000:1.0:1790391336.969364:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186386688 00000100:00100000:1.0:1790391336.969425:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790391336.969434:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186386688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391336.969471:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391336.969528:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186386688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391336.969536:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1790391336.969581:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828000 x1877361186386688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391336.969599:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186386688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391336.974403:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391336.974431:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186386816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391336.974513:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391336.974626:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186386816 00000100:00100000:1.0:1790391336.974635:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186386816 00000100:00100000:1.0:1790391336.974683:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790391336.974693:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186386816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391336.974716:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391336.974779:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186386816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391336.974786:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1790391336.975091:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828000 x1877361186386816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391336.975113:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186386816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790391337.931429:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391337.992905:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186387072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391337.992978:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391337.993145:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186387072 00000100:00100000:1.0:1790391337.993154:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186387072 00000100:00100000:3.0:1790391337.993862:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186386944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391337.993947:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391337.994248:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186386944 00000100:00100000:3.0:1790391337.994256:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186386944 00000100:00100000:3.0:1790391337.994302:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790391337.994312:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186386944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391337.994345:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391337.994394:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186386944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391337.994402:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1790391337.994448:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831df800 x1877361186386944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391337.994469:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186386944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391337.994551:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790391337.994561:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186387072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391337.994573:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391337.994609:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186387072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391337.994616:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1790391337.996639:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822a5f80 x1877361186387072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391337.996672:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186387072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391337.997859:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391337.998091:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186387200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391337.998167:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391337.999059:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186387200 00000100:00100000:1.0:1790391337.999070:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186387200 00000100:00100000:1.0:1790391337.999143:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790391337.999152:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186387200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391337.999289:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790391337.999353:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186387200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 201us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391337.999359:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391337.999432:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186387200:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790391338.952101:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790391339.655915:0:11311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.4 00010000:00010000:1.0:1790391339.976927:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391340.044597:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186387328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391340.044676:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391340.044749:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186387328 00000100:00100000:0.0:1790391340.044759:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186387328 00000100:00100000:0.0:1790391340.044816:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790391340.044826:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186387328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790391340.044864:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790391340.044964:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186387328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391340.044972:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790391340.045044:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186387328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391340.934981:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391340.935026:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391340.935048:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391340.935140:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169540736 00000100:00100000:1.0:1790391340.935150:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169540736 00000100:00100000:1.0:1790391340.935217:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169540608 00000100:00100000:1.0:1790391340.935220:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169540608 00000100:00100000:1.0:1790391340.935241:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 99 00000100:00100000:1.0:1790391340.935249:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169540736:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391340.935318:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169540736:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 69us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391340.935326:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 99 00000100:00100000:1.0:1790391340.935342:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 100 00000100:00100000:1.0:1790391340.935348:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2381:x1877361169540608:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391340.935370:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2381:x1877361169540608:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 23us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391340.935376:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 100 00000100:00080000:0.0:1790391340.935434:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391340.935438:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391340.935677:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169540480 00000100:00100000:3.0:1790391340.935681:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169540480 00000100:00100000:3.0:1790391340.935730:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 283 00000100:00100000:3.0:1790391340.935739:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2381:x1877361169540480:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391340.935771:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2381:x1877361169540480:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 35us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391340.935819:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 283 00010000:00010000:2.0:1790391341.000239:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391341.519261:0:11359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 25 22:55:40 EDT 2026 00000100:00100000:1.0:1790391341.576128:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186387456:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576201:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576242:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186387968:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576263:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576285:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186388480:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576304:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576317:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186388992:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576332:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576351:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790391341.576356:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186387584:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576375:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576387:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186388096:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576401:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576413:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186388608:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576427:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576450:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186387840:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576468:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576480:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186388352:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576496:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576509:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186388864:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576526:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576538:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790391341.576543:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186387712:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576558:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576569:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186388224:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576590:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186388736:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576607:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391341.576637:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186387456 00000100:00100000:1.0:1790391341.576644:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186387456 00000100:00100000:1.0:1790391341.576688:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1790391341.576695:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186387456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576738:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186387456:12345-0@lo:400:kworker.0 Request processed in 43us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.576745:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1790391341.576773:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186387968 00000100:00100000:1.0:1790391341.576775:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186387968 00000100:00100000:1.0:1790391341.576793:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186387712 00000100:00100000:1.0:1790391341.576795:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186387712 00000100:00100000:1.0:1790391341.576805:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790391341.576810:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186387968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576837:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186387968:12345-0@lo:400:kworker.0 Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.576843:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790391341.576852:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790391341.576856:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186387712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.576924:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186387712:12345-0@lo:400:kworker.0 Request processed in 68us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.576930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790391341.576944:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186388480 00000100:00100000:1.0:1790391341.576947:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186388480 00000100:00100000:1.0:1790391341.576974:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186388992 00000100:00100000:1.0:1790391341.576976:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186388992 00000100:00100000:1.0:1790391341.576985:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186388352 00000100:00100000:1.0:1790391341.576987:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186388352 00000100:00100000:1.0:1790391341.576996:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186388864 00000100:00100000:1.0:1790391341.576998:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186388864 00000100:00100000:1.0:1790391341.577018:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391341.577022:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186388480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577048:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186388480:12345-0@lo:400:kworker.0 Request processed in 26us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.577053:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391341.577062:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790391341.577067:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186388992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577086:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186388992:12345-0@lo:400:kworker.0 Request processed in 19us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.577091:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790391341.577098:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790391341.577102:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186388352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577120:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186388352:12345-0@lo:400:kworker.0 Request processed in 17us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.577125:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790391341.577132:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790391341.577136:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186388864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577153:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186388864:12345-0@lo:400:kworker.0 Request processed in 17us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.577158:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790391341.577175:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186387584 00000100:00100000:1.0:1790391341.577178:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186387584 00000100:00100000:1.0:1790391341.577191:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186388096 00000100:00100000:1.0:1790391341.577193:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186388096 00000100:00100000:1.0:1790391341.577203:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186388608 00000100:00100000:1.0:1790391341.577205:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186388608 00000100:00100000:1.0:1790391341.577212:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186387840 00000100:00100000:1.0:1790391341.577219:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186387840 00000100:00100000:1.0:1790391341.577229:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186388224 00000100:00100000:1.0:1790391341.577231:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186388224 00000100:00100000:1.0:1790391341.577240:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186388736 00000100:00100000:1.0:1790391341.577242:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186388736 00000100:00100000:1.0:1790391341.577253:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790391341.577258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186387584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577281:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186387584:12345-0@lo:400:kworker.0 Request processed in 24us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.577287:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790391341.577295:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391341.577300:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186388096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577320:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186388096:12345-0@lo:400:kworker.0 Request processed in 20us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.577325:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391341.577333:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790391341.577337:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186388608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577356:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186388608:12345-0@lo:400:kworker.0 Request processed in 18us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.577361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790391341.577368:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391341.577373:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186387840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577390:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186387840:12345-0@lo:400:kworker.0 Request processed in 18us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.577395:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391341.577403:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790391341.577407:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186388224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577431:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186388224:12345-0@lo:400:kworker.0 Request processed in 24us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.577437:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790391341.577446:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790391341.577451:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186388736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577469:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186388736:12345-0@lo:400:kworker.0 Request processed in 19us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391341.577474:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790391341.577524:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186387712:0@lo:400:kworker.0 00010000:00080000:1.0:1790391341.577535:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382bb80 x1877361186388224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391341.577545:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186388224:0@lo:400:kworker.0 00010000:00080000:1.0:1790391341.577553:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382ad80 x1877361186388736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391341.577561:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186388736:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577569:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186387840:0@lo:400:kworker.0 00010000:00080000:1.0:1790391341.577577:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829f80 x1877361186388352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391341.577585:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186388352:0@lo:400:kworker.0 00010000:00080000:1.0:1790391341.577593:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828000 x1877361186388864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391341.577600:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186388864:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577644:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186387584:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577653:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186388096:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577660:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186388608:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577667:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186387456:0@lo:400:kworker.0 00000100:00100000:1.0:1790391341.577675:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186387968:0@lo:400:kworker.0 00010000:00080000:1.0:1790391341.577684:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829180 x1877361186388480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391341.577692:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186388480:0@lo:400:kworker.0 00010000:00080000:1.0:1790391341.577699:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183896300 x1877361186388992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391341.577706:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186388992:0@lo:400:kworker.0 00000100:00080000:0.0:1790391341.580151:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391341.580159:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391341.580162:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391341.580165:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790391342.024123:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391342.089185:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186389120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391342.089259:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391342.089285:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186389120 00000100:00100000:2.0:1790391342.089304:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186389120 00000100:00100000:2.0:1790391342.089365:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790391342.089374:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186389120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391342.089404:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391342.089449:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186389120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391342.089456:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1790391342.089494:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183896300 x1877361186389120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391342.089512:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186389120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391342.089578:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186389248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391342.089620:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391342.090191:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186389248 00000100:00100000:3.0:1790391342.090196:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186389248 00000100:00100000:3.0:1790391342.090234:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790391342.090243:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186389248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790391342.090256:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391342.090305:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186389248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391342.090311:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1790391342.090455:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382d180 x1877361186389248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391342.090470:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186389248:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1790391343.048089:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391343.113502:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186389376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391343.113613:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391343.114014:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186389376 00000100:00100000:3.0:1790391343.114025:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186389376 00000100:00100000:3.0:1790391343.114086:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790391343.114097:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186389376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391343.114144:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790391343.114206:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186389376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391343.114213:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790391343.114272:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186389376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391343.114482:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391343.114494:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186389504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391343.114533:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391343.116257:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391343.116281:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186389632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391343.116362:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391343.116427:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186389504 00000100:00100000:0.0:1790391343.116436:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186389504 00000100:00100000:0.0:1790391343.116498:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186389632 00000100:00100000:0.0:1790391343.116501:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186389632 00000100:00100000:0.0:1790391343.116522:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790391343.116531:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186389504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391343.116643:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391343.117197:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790391343.117210:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186389632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391343.117217:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186389504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 686us (2683us total) trans 0 rc 0/0 00002000:00000024:3.0:1790391343.117225:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391343.117225:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1790391343.117252:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391343.117263:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186389632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391343.117269:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1790391343.120209:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52849b8e00 x1877361186389632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391343.120248:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186389632:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1790391343.121091:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382e680 x1877361186389504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391343.121113:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186389504:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790391344.078528:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391345.096229:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391345.166914:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186389760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391345.167025:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391345.167249:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186389760 00000100:00100000:0.0:1790391345.167261:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186389760 00000100:00100000:0.0:1790391345.167319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790391345.167330:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186389760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790391345.167384:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790391345.167460:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186389760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391345.167479:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790391345.167917:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186389760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391346.082658:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391346.082706:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391346.082752:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391346.082931:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169541120 00000100:00100000:2.0:1790391346.082945:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169541120 00000100:00100000:2.0:1790391346.083222:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169540992 00000100:00100000:2.0:1790391346.083227:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169540992 00000100:00100000:2.0:1790391346.083268:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 107 00000100:00100000:2.0:1790391346.083279:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169541120:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391346.083370:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169541120:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 94us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.083376:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 107 00000100:00100000:2.0:1790391346.083497:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 108 00000100:00100000:2.0:1790391346.083502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169540992:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391346.083522:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169540992:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 21us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.083526:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 108 00000100:00080000:1.0:1790391346.083588:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391346.083592:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391346.084710:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169540864 00000100:00100000:3.0:1790391346.084724:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169540864 00000100:00100000:3.0:1790391346.084785:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 285 00000100:00100000:3.0:1790391346.084939:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2382:x1877361169540864:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391346.085011:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2382:x1877361169540864:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 76us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391346.085160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 285 00010000:00010000:1.0:1790391346.120185:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391346.696574:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186389888:0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.696682:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391346.696757:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186390400:0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.696787:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391346.696857:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186390912:0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.696914:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391346.696938:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186391424:0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.696960:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391346.696991:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790391346.697015:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186390272:0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.697045:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391346.697063:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186390784:0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.697085:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391346.697104:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186391296:0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.697130:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391346.697169:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186390400 00000100:00100000:3.0:1790391346.697179:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186390400 00000100:00100000:3.0:1790391346.697239:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790391346.697250:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186390400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.697317:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186390400:12345-0@lo:400:kworker.0 Request processed in 68us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391346.697325:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790391346.697352:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186390912 00000100:00100000:3.0:1790391346.697373:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186390912 00000100:00100000:3.0:1790391346.697413:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186391424 00000100:00100000:3.0:1790391346.697416:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186391424 00000100:00100000:3.0:1790391346.697431:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186390784 00000100:00100000:3.0:1790391346.697433:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186390784 00000100:00100000:2.0:1790391346.697602:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186390272 00000100:00100000:2.0:1790391346.697607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186390272 00000100:00100000:2.0:1790391346.697643:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790391346.697651:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186390272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391346.697693:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186390272:12345-0@lo:400:kworker.0 Request processed in 44us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.697701:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790391346.697858:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186391296 00000100:00100000:2.0:1790391346.697863:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186391296 00000100:00100000:0.0:1790391346.698433:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186390016:0@lo:400:kworker.0 00000100:00100000:0.0:1790391346.698499:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391346.698532:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186390528:0@lo:400:kworker.0 00000100:00100000:0.0:1790391346.698554:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391346.698570:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186391040:0@lo:400:kworker.0 00000100:00100000:0.0:1790391346.698591:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391346.699268:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186390144:0@lo:400:kworker.0 00000100:00100000:1.0:1790391346.699333:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391346.699365:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186390656:0@lo:400:kworker.0 00000100:00100000:1.0:1790391346.699388:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391346.699408:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186391168:0@lo:400:kworker.0 00000100:00100000:1.0:1790391346.699429:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391346.699480:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186389888 00000100:00100000:1.0:1790391346.699488:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186389888 00000100:00100000:1.0:1790391346.699535:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790391346.699544:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186389888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391346.699594:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186389888:12345-0@lo:400:kworker.0 Request processed in 50us (2911us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.699601:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790391346.699636:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186390144 00000100:00100000:1.0:1790391346.699641:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186390144 00000100:00100000:1.0:1790391346.699670:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790391346.699677:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186390144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391346.699717:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186390144:12345-0@lo:400:kworker.0 Request processed in 40us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.699724:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790391346.699747:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186390016 00000100:00100000:1.0:1790391346.699751:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186390016 00000100:00100000:1.0:1790391346.699771:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186390528 00000100:00100000:1.0:1790391346.699773:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186390528 00000100:00100000:1.0:1790391346.699790:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186391040 00000100:00100000:1.0:1790391346.699793:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186391040 00000100:00100000:1.0:1790391346.699806:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186390656 00000100:00100000:1.0:1790391346.699808:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186390656 00000100:00100000:1.0:1790391346.699840:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186391168 00000100:00100000:1.0:1790391346.699850:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186391168 00000100:00100000:1.0:1790391346.699869:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790391346.699899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186390016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391346.699944:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186390016:12345-0@lo:400:kworker.0 Request processed in 68us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.699950:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790391346.699964:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790391346.699970:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186390528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391346.700014:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186390528:12345-0@lo:400:kworker.0 Request processed in 30us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.700021:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790391346.700046:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790391346.700053:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186391040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391346.700084:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186391040:12345-0@lo:400:kworker.0 Request processed in 32us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.700090:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790391346.700100:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790391346.700105:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186390656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391346.700130:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186390656:12345-0@lo:400:kworker.0 Request processed in 25us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.700136:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790391346.700145:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790391346.700151:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186391168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391346.700179:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186391168:12345-0@lo:400:kworker.0 Request processed in 28us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391346.700195:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790391346.700242:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186390144:0@lo:400:kworker.0 00010000:00080000:1.0:1790391346.700259:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382aa00 x1877361186390656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391346.700270:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186390656:0@lo:400:kworker.0 00010000:00080000:1.0:1790391346.700281:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828000 x1877361186391168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391346.700291:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186391168:0@lo:400:kworker.0 00000100:00100000:2.0:1790391346.701388:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391346.701406:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186390912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391346.702587:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186390912:12345-0@lo:400:kworker.0 Request processed in 1044us (5527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.702601:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391346.702636:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391346.702648:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186391424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391346.702692:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186391424:12345-0@lo:400:kworker.0 Request processed in 49us (5731us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.702699:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391346.702710:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790391346.702718:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186390784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391346.702782:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186390784:12345-0@lo:400:kworker.0 Request processed in 65us (5696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.702789:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790391346.702802:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790391346.702822:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186391296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391346.702854:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186391296:12345-0@lo:400:kworker.0 Request processed in 46us (5724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391346.702861:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1790391346.703770:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391346.703781:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391346.703786:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391346.703789:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391346.704842:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186390272:0@lo:400:kworker.0 00010000:00080000:2.0:1790391346.704896:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828a80 x1877361186390784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391346.704911:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186390784:0@lo:400:kworker.0 00010000:00080000:2.0:1790391346.704927:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829f80 x1877361186391296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391346.704938:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186391296:0@lo:400:kworker.0 00000100:00100000:2.0:1790391346.704953:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186389888:0@lo:400:kworker.0 00000100:00100000:2.0:1790391346.704967:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186390400:0@lo:400:kworker.0 00010000:00080000:2.0:1790391346.704980:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829880 x1877361186390912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391346.704990:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186390912:0@lo:400:kworker.0 00010000:00080000:2.0:1790391346.705352:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828e00 x1877361186391424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391346.705363:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186391424:0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.710428:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186390016:0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.710471:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186390528:0@lo:400:kworker.0 00000100:00100000:3.0:1790391346.710487:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186391040:0@lo:400:kworker.0 00010000:00010000:0.0:1790391347.150255:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391347.209486:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391347.209508:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186391552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391347.209575:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391347.209676:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186391552 00000100:00100000:2.0:1790391347.209685:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186391552 00000100:00100000:2.0:1790391347.209729:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391347.209738:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186391552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790391347.209766:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391347.209827:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186391552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391347.209835:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1790391347.209891:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382e680 x1877361186391552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391347.209909:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186391552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391347.210045:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186391680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391347.210071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391347.210136:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186391680 00000100:00100000:0.0:1790391347.210141:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186391680 00000100:00100000:0.0:1790391347.210171:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790391347.210178:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186391680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391347.210189:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391347.210225:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186391680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391347.210231:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1790391347.210256:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b5d05880 x1877361186391680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391347.210267:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186391680:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790391348.168101:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391348.232103:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186391808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391348.232178:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391348.232775:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186391808 00000100:00100000:0.0:1790391348.232785:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186391808 00000100:00100000:0.0:1790391348.232859:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790391348.232870:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186391808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391348.232926:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391348.232980:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186391808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391348.233011:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1790391348.233058:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b5d05880 x1877361186391808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391348.233078:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186391808:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790391348.233171:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391348.233387:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391348.233397:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186391936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391348.233432:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391348.233494:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186391936 00000100:00100000:0.0:1790391348.233498:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186391936 00000100:00100000:0.0:1790391348.233532:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790391348.233539:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186391936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391348.233562:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391348.233597:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186391936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391348.233603:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790391348.233629:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186391936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391348.235869:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391348.235927:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186392064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391348.235990:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391348.236042:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186392064 00000100:00100000:0.0:1790391348.236050:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186392064 00000100:00100000:0.0:1790391348.236100:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790391348.236107:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186392064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391348.236128:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391348.236167:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186392064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391348.236174:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1790391348.236191:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790391348.236231:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831b9c00 x1877361186392064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391348.236248:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186392064:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790391349.193435:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391350.217385:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391350.280689:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391350.280714:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186392192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391350.280830:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391350.281025:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186392192 00000100:00100000:3.0:1790391350.281036:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186392192 00000100:00100000:3.0:1790391350.281084:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790391350.281094:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186392192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391350.281131:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790391350.281189:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186392192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391350.281197:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790391350.281587:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186392192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391351.175493:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391351.175531:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391351.175557:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391351.175588:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169541248 00000100:00100000:3.0:1790391351.175596:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169541248 00000100:00100000:3.0:1790391351.175677:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 287 00000100:00100000:3.0:1790391351.175688:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2382:x1877361169541248:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391351.175758:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2382:x1877361169541248:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391351.175765:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 287 00000100:00100000:3.0:1790391351.175811:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169541376 00000100:00100000:3.0:1790391351.175815:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169541376 00000100:00100000:3.0:1790391351.175847:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169541504 00000100:00100000:3.0:1790391351.175850:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169541504 00000100:00100000:3.0:1790391351.175872:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 115 00000100:00100000:3.0:1790391351.175899:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169541376:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391351.175930:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169541376:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 53us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391351.175937:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 115 00000100:00100000:3.0:1790391351.175948:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 116 00000100:00100000:3.0:1790391351.175954:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169541504:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391351.175978:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169541504:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391351.175983:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 116 00000100:00080000:0.0:1790391351.176787:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391351.176792:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790391351.246106:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391351.816499:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186392576:0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.816569:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391351.816619:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186393088:0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.816645:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391351.816663:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186393600:0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.816681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391351.816701:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790391351.816715:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186392704:0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.816736:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391351.816752:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186393216:0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.816785:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391351.816808:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186393728:0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.816828:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391351.816861:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186392576 00000100:00100000:2.0:1790391351.817020:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186392576 00000100:00100000:2.0:1790391351.817067:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790391351.817076:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186392576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.817129:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186392576:12345-0@lo:400:kworker.0 Request processed in 54us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391351.817136:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790391351.817158:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186393088 00000100:00100000:2.0:1790391351.817162:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186393088 00000100:00100000:2.0:1790391351.817198:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186393600 00000100:00100000:2.0:1790391351.817202:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186393600 00000100:00100000:2.0:1790391351.817214:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186392704 00000100:00100000:2.0:1790391351.817215:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186392704 00000100:00100000:2.0:1790391351.817226:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790391351.817231:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186393088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.817262:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186393088:12345-0@lo:400:kworker.0 Request processed in 31us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391351.817268:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790391351.817278:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790391351.817283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186393600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.817309:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186393600:12345-0@lo:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391351.817322:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790391351.817334:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790391351.817340:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186392704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.817371:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186392704:12345-0@lo:400:kworker.0 Request processed in 31us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391351.817376:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790391351.817399:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186393216 00000100:00100000:2.0:1790391351.817402:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186393216 00000100:00100000:2.0:1790391351.817427:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186393728 00000100:00100000:2.0:1790391351.817431:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186393728 00000100:00100000:2.0:1790391351.817449:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790391351.817456:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186393216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.817484:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186393216:12345-0@lo:400:kworker.0 Request processed in 29us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391351.817491:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790391351.817501:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790391351.817506:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186393728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.817533:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186393728:12345-0@lo:400:kworker.0 Request processed in 27us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391351.817540:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790391351.818045:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186392320:0@lo:400:kworker.0 00000100:00100000:1.0:1790391351.818083:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391351.818119:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186392832:0@lo:400:kworker.0 00000100:00100000:1.0:1790391351.818139:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391351.818151:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186393344:0@lo:400:kworker.0 00000100:00100000:1.0:1790391351.818169:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391351.818182:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186393856:0@lo:400:kworker.0 00000100:00100000:1.0:1790391351.818197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391351.818214:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790391351.818219:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186392448:0@lo:400:kworker.0 00000100:00100000:1.0:1790391351.818247:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391351.818260:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186392960:0@lo:400:kworker.0 00000100:00100000:1.0:1790391351.818276:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391351.818288:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186393472:0@lo:400:kworker.0 00000100:00100000:1.0:1790391351.818303:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391351.818324:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186393344 00000100:00100000:1.0:1790391351.818328:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186393344 00000100:00100000:1.0:1790391351.818364:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186393856 00000100:00100000:1.0:1790391351.818367:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186393856 00000100:00100000:1.0:1790391351.818381:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391351.818387:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186393344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391351.818421:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186393344:12345-0@lo:400:kworker.0 Request processed in 34us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391351.818427:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391351.818438:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790391351.818443:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186393856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391351.818462:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186393856:12345-0@lo:400:kworker.0 Request processed in 20us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391351.818467:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1790391351.818496:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a4a80 x1877361186393344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391351.818508:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186393344:0@lo:400:kworker.0 00010000:00080000:1.0:1790391351.818518:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51839f5c00 x1877361186393856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391351.818526:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186393856:0@lo:400:kworker.0 00000100:00100000:0.0:1790391351.818653:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186392320 00000100:00100000:0.0:1790391351.818658:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186392320 00000100:00100000:0.0:1790391351.818696:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1790391351.818702:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186392320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391351.818738:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186392320:12345-0@lo:400:kworker.0 Request processed in 36us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391351.818743:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1790391351.818778:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186392832 00000100:00100000:0.0:1790391351.818782:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186392832 00000100:00100000:0.0:1790391351.818802:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790391351.818808:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186392832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391351.818833:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186392832:12345-0@lo:400:kworker.0 Request processed in 26us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391351.818839:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790391351.818861:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186392320:0@lo:400:kworker.0 00000100:00100000:0.0:1790391351.818989:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186392832:0@lo:400:kworker.0 00000100:00100000:0.0:1790391351.819103:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186392448 00000100:00100000:0.0:1790391351.819107:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186392448 00000100:00100000:0.0:1790391351.819123:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186392960 00000100:00100000:0.0:1790391351.819125:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186392960 00000100:00100000:0.0:1790391351.819136:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186393472 00000100:00100000:0.0:1790391351.819138:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186393472 00000100:00100000:0.0:1790391351.819149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790391351.819155:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186392448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391351.819620:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186392448:12345-0@lo:400:kworker.0 Request processed in 463us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391351.819627:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790391351.819641:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790391351.819647:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186392960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391351.819697:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186392960:12345-0@lo:400:kworker.0 Request processed in 49us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391351.819703:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790391351.819715:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790391351.819720:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186393472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391351.819744:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186393472:12345-0@lo:400:kworker.0 Request processed in 24us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391351.819748:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1790391351.819775:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391351.819780:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391351.819782:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391351.819785:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391351.819821:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186392704:0@lo:400:kworker.0 00010000:00080000:0.0:1790391351.819836:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a7100 x1877361186393216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391351.819853:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186393216:0@lo:400:kworker.0 00010000:00080000:0.0:1790391351.819902:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a7b80 x1877361186393728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391351.819911:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186393728:0@lo:400:kworker.0 00000100:00100000:0.0:1790391351.819923:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186392576:0@lo:400:kworker.0 00010000:00080000:0.0:1790391351.819934:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382d500 x1877361186393088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391351.819941:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186393088:0@lo:400:kworker.0 00010000:00080000:0.0:1790391351.819951:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a6a00 x1877361186393600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391351.819958:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186393600:0@lo:400:kworker.0 00000100:00100000:1.0:1790391351.823234:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186392448:0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.824580:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186392960:0@lo:400:kworker.0 00000100:00100000:2.0:1790391351.824598:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186393472:0@lo:400:kworker.0 00010000:00010000:1.0:1790391352.265794:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391352.328108:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391352.328133:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186393984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391352.328202:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391352.328524:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186393984 00000100:00100000:0.0:1790391352.328532:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186393984 00000100:00100000:0.0:1790391352.328584:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790391352.328594:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186393984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391352.328621:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391352.328676:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186393984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391352.328683:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1790391352.328779:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51833cad80 x1877361186393984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391352.328799:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186393984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391352.329149:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391352.329161:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186394112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391352.329197:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391352.329336:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186394112 00000100:00100000:2.0:1790391352.329351:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186394112 00000100:00100000:2.0:1790391352.329386:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790391352.329393:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186394112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790391352.329404:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391352.329438:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186394112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391352.329444:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1790391352.329470:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51839f4380 x1877361186394112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391352.329483:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186394112:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1790391353.288185:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391353.352120:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186394240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391353.352193:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391353.352278:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186394240 00000100:00100000:0.0:1790391353.352292:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186394240 00000100:00100000:0.0:1790391353.352345:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790391353.352354:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186394240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391353.352389:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391353.352430:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186394240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391353.352437:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790391353.352478:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186394240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391353.352770:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391353.352781:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186394368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391353.352815:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391353.352849:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186394368 00000100:00100000:1.0:1790391353.352853:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186394368 00000100:00100000:1.0:1790391353.352919:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391353.352926:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186394368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391353.352946:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391353.352978:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186394368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391353.352984:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1790391353.353000:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790391353.353030:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828a80 x1877361186394368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391353.353044:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186394368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391353.357270:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391353.357293:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186394496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391353.357372:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391353.357426:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186394496 00000100:00100000:3.0:1790391353.357434:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186394496 00000100:00100000:3.0:1790391353.357693:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790391353.357704:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186394496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391353.357735:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391353.357799:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186394496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391353.357807:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1790391353.357829:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790391353.358019:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831bb100 x1877361186394496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391353.358038:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186394496:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790391354.312080:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391355.345021:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391355.401691:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391355.401717:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186394624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391355.403237:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391355.403407:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186394624 00000100:00100000:3.0:1790391355.403416:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186394624 00000100:00100000:3.0:1790391355.403475:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790391355.403485:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186394624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391355.403527:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790391355.403602:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186394624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391355.403609:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790391355.403657:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186394624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391356.295705:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391356.295759:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391356.295795:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391356.296130:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169541888 00000100:00100000:2.0:1790391356.296140:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169541888 00000100:00100000:2.0:1790391356.296203:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169541760 00000100:00100000:2.0:1790391356.296207:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169541760 00000100:00100000:2.0:1790391356.296228:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 123 00000100:00100000:2.0:1790391356.296238:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169541888:12345-192.168.202.28@tcp:400:kworker.0 00000100:00080000:3.0:1790391356.296284:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391356.296289:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391356.296314:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169541888:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 77us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391356.296317:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 124 00000100:00100000:2.0:1790391356.296322:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 123 00000100:00100000:3.0:1790391356.296325:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169541760:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391356.296352:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169541760:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391356.296357:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 124 00000100:00100000:1.0:1790391356.296778:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169541632 00000100:00100000:1.0:1790391356.296784:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169541632 00000100:00100000:1.0:1790391356.296839:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 289 00000100:00100000:1.0:1790391356.296846:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2382:x1877361169541632:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391356.296897:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2382:x1877361169541632:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 51us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391356.296903:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 289 00010000:00010000:0.0:1790391356.360102:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391356.936339:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391356.936364:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186395136:0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.936443:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391356.936494:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186395264:0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.936517:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186394752:0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.936527:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391356.936544:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391356.936548:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186395776:0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.936567:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186395648:0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.936567:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391356.936583:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186396288:0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.936587:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391356.936610:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186395264 00000100:00100000:0.0:1790391356.936617:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186395264 00000100:00100000:1.0:1790391356.936618:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186396160:0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.936636:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391356.936659:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790391356.936663:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186394752 00000100:00100000:1.0:1790391356.936666:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186394752 00000100:00100000:0.0:1790391356.936667:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186395264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.936692:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1790391356.936697:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186394752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.936744:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186395264:12345-0@lo:400:kworker.0 Request processed in 49us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391356.936752:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790391356.936753:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186394752:12345-0@lo:400:kworker.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391356.936758:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1790391356.936784:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186395776 00000100:00100000:1.0:1790391356.936788:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186395776 00000100:00100000:0.0:1790391356.936799:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186395648 00000100:00100000:0.0:1790391356.936802:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186395648 00000100:00100000:1.0:1790391356.936816:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186396160 00000100:00100000:1.0:1790391356.936819:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186396160 00000100:00100000:0.0:1790391356.936820:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790391356.936826:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186395776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.936832:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790391356.936844:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186395648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.936856:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186395776:12345-0@lo:400:kworker.0 Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391356.936861:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790391356.936867:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186395648:12345-0@lo:400:kworker.0 Request processed in 24us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391356.936871:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790391356.936898:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186396160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.936904:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790391356.936926:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186396160:12345-0@lo:400:kworker.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00080000:1.0:1790391356.936931:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391356.936932:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1790391356.936934:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391356.936951:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790391356.936974:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820ae300 x1877361186395648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391356.936978:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186395264:0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.936984:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186395648:0@lo:400:kworker.0 00010000:00080000:0.0:1790391356.936987:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820ac000 x1877361186395776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1790391356.936992:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229ed80 x1877361186396160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391356.936996:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186395776:0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.937000:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186396160:0@lo:400:kworker.0 00000100:00100000:1.0:1790391356.937006:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186394752:0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937022:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186396288 00000100:00100000:0.0:1790391356.937025:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186396288 00000100:00080000:1.0:1790391356.937044:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391356.937047:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790391356.937053:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186396288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937090:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186396288:12345-0@lo:400:kworker.0 Request processed in 37us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391356.937096:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790391356.937106:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186394880:0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937118:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186395008:0@lo:400:kworker.0 00000100:00100000:2.0:1790391356.937140:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391356.937140:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391356.937159:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186395392:0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937159:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186395520:0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937177:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391356.937187:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186395136 00000100:00100000:0.0:1790391356.937194:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186396032:0@lo:400:kworker.0 00000100:00100000:2.0:1790391356.937203:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186395136 00000100:00100000:0.0:1790391356.937212:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391356.937224:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186394880 00000100:00100000:2.0:1790391356.937227:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186394880 00000100:00100000:0.0:1790391356.937235:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186395008 00000100:00100000:2.0:1790391356.937236:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186395520 00000100:00100000:2.0:1790391356.937238:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186395520 00000100:00100000:0.0:1790391356.937238:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186395008 00000100:00100000:2.0:1790391356.937254:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186396032 00000100:00100000:0.0:1790391356.937255:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790391356.937256:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186396032 00000100:00100000:0.0:1790391356.937260:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186395008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391356.937268:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790391356.937273:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186395136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937291:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186395008:12345-0@lo:400:kworker.0 Request processed in 31us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391356.937303:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186395136:12345-0@lo:400:kworker.0 Request processed in 30us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391356.937309:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790391356.937311:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790391356.937320:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790391356.937326:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186394880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937326:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790391356.937331:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186395520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391356.937351:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186394880:12345-0@lo:400:kworker.0 Request processed in 26us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391356.937352:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186395520:12345-0@lo:400:kworker.0 Request processed in 22us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391356.937356:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790391356.937359:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790391356.937366:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790391356.937371:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186396032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937383:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186395008:0@lo:400:kworker.0 00010000:00080000:0.0:1790391356.937393:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820aed80 x1877361186395520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391356.937395:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186396032:12345-0@lo:400:kworker.0 Request processed in 24us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391356.937400:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790391356.937402:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186395520:0@lo:400:kworker.0 00010000:00080000:0.0:1790391356.937410:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229e300 x1877361186396032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391356.937413:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391356.937418:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186396032:0@lo:400:kworker.0 00000100:00100000:2.0:1790391356.937421:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391356.937436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186395392 00000100:00100000:2.0:1790391356.937443:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186395904:0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937443:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186395392 00000100:00100000:2.0:1790391356.937463:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391356.937466:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186395904 00000100:00100000:0.0:1790391356.937469:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186395904 00000100:00100000:0.0:1790391356.937481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790391356.937482:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186394880:0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937486:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186395392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391356.937503:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186395136:0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186395392:12345-0@lo:400:kworker.0 Request processed in 30us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391356.937522:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186395392:0@lo:400:kworker.0 00000100:00100000:0.0:1790391356.937523:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790391356.937533:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790391356.937539:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186395904:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790391356.937541:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391356.937567:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186395904:12345-0@lo:400:kworker.0 Request processed in 28us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391356.937572:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790391356.937582:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186395904:0@lo:400:kworker.0 00010000:00080000:1.0:1790391356.937776:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229f800 x1877361186396288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391356.937785:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186396288:0@lo:400:kworker.0 00010000:00010000:2.0:1790391357.387209:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391357.448140:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391357.448164:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186396416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391357.448231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391357.448302:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186396416 00000100:00100000:1.0:1790391357.448311:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186396416 00000100:00100000:1.0:1790391357.448371:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790391357.448381:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186396416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391357.448437:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391357.448491:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186396416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391357.448498:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1790391357.448522:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51839f4a80 x1877361186396416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391357.448542:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186396416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391357.448581:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186396544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391357.448609:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391357.448743:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186396544 00000100:00100000:2.0:1790391357.448749:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186396544 00000100:00100000:2.0:1790391357.448782:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391357.448789:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186396544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391357.448800:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391357.448837:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186396544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391357.448842:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1790391357.448867:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51839f5500 x1877361186396544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391357.448902:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186396544:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1790391357.944363:0:11989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:55:57 (1790391357) === 00000100:00100000:3.0:1790391358.279232:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391358.279412:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169542016 00000100:00100000:2.0:1790391358.279424:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169542016 00000100:00100000:2.0:1790391358.279488:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 291 00000100:00100000:2.0:1790391358.279499:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:8712:x1877361169542016:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790391358.279533:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391358.279550:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e1052 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0035 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391358.279580:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e1052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0035 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391358.279591:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e1052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0035 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391358.279601:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309da00, rc 0) 00000100:00100000:2.0:1790391358.279662:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8712:x1877361169542016:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 165us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391358.279670:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 291 00000100:00100000:3.0:1790391358.288998:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391358.289131:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169542144 00000100:00100000:1.0:1790391358.289155:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169542144 00000100:00100000:1.0:1790391358.289229:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 292 00000100:00100000:1.0:1790391358.289239:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8712:x1877361169542144:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790391358.289758:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8712:x1877361169542144:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 518us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.289768:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 292 00000100:00100000:3.0:1790391358.304377:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391358.304524:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169542272 00000100:00100000:1.0:1790391358.304535:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169542272 00000100:00100000:1.0:1790391358.304592:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 293 00000100:00100000:1.0:1790391358.304603:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8712:x1877361169542272:12345-192.168.202.28@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790391358.304793:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8712:x1877361169542272:12345-192.168.202.28@tcp:503:mount.lustre.0 Request processed in 191us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.304801:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 293 00000100:00100000:2.0:1790391358.315421:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391358.315493:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169542400 00000100:00100000:1.0:1790391358.315504:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169542400 00000100:00100000:1.0:1790391358.315613:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 294 00000100:00100000:1.0:1790391358.315624:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8716:x1877361169542400:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391358.315803:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8716:x1877361169542400:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 181us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.315809:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 294 00000100:00100000:3.0:1790391358.342543:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391358.342647:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169542528 00000100:00100000:0.0:1790391358.342657:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169542528 00000100:00100000:0.0:1790391358.342730:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 295 00000100:00100000:0.0:1790391358.342740:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8716:x1877361169542528:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391358.342957:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8716:x1877361169542528:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 217us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.342965:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 295 00000100:00100000:3.0:1790391358.349799:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391358.350416:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169542656 00000100:00100000:1.0:1790391358.350427:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169542656 00000100:00100000:1.0:1790391358.350485:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 296 00000100:00100000:1.0:1790391358.350495:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8716:x1877361169542656:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391358.350652:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8716:x1877361169542656:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 158us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.350660:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 296 00000100:00100000:1.0:1790391358.353070:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391358.353245:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169542784 00000100:00100000:2.0:1790391358.353254:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169542784 00000100:00100000:2.0:1790391358.353493:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 297 00000100:00100000:2.0:1790391358.353506:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:8712:x1877361169542784:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790391358.353523:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391358.353541:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309c000/0x2b1b7949f13e1059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0066 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391358.353569:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309c000/0x2b1b7949f13e1059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0066 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391358.353581:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309c000/0x2b1b7949f13e1059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0066 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391358.353607:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c000, rc 0) 00000100:00100000:2.0:1790391358.354007:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:8712:x1877361169542784:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 503us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391358.354014:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 297 00000100:00100000:3.0:1790391358.362525:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391358.362628:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169542912 00000100:00100000:0.0:1790391358.362639:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169542912 00000100:00100000:0.0:1790391358.362710:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 298 00000100:00100000:0.0:1790391358.362720:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:8712:x1877361169542912:12345-192.168.202.28@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790391358.362746:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790391358.362769:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790391358.362774:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790391358.362777:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790391358.362780:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1790391358.362783:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1790391358.372123:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:8712:x1877361169542912:12345-192.168.202.28@tcp:256:mount.lustre.0 Request processed in 9394us (9597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.372135:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 298 00000100:00100000:2.0:1790391358.375079:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391358.375175:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169543040 00000100:00100000:1.0:1790391358.375193:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169543040 00000100:00100000:1.0:1790391358.375241:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 299 00000100:00100000:1.0:1790391358.375251:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:8712:x1877361169543040:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790391358.375267:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391358.375447:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e1060 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b006d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391358.375479:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e1060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b006d expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391358.375490:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e1060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b006d expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391358.375500:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52c21f6600, rc 0) 00000100:00100000:1.0:1790391358.375551:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:8712:x1877361169543040:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 301us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.375558:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 299 00000100:00100000:3.0:1790391358.377304:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391358.377459:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169543168 00000100:00100000:0.0:1790391358.377468:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169543168 00000100:00100000:0.0:1790391358.377519:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 300 00000100:00100000:0.0:1790391358.377528:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:8712:x1877361169543168:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790391358.377681:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:8712:x1877361169543168:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 153us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.377689:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 300 00000100:00100000:3.0:1790391358.381943:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391358.382105:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169543296 00000100:00100000:1.0:1790391358.382134:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169543296 00000100:00100000:1.0:1790391358.382207:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 301 00000100:00100000:1.0:1790391358.382219:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:8712:x1877361169543296:12345-192.168.202.28@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790391358.382660:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:8712:x1877361169543296:12345-192.168.202.28@tcp:503:mount.lustre.0 Request processed in 442us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.382669:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 301 00000100:00100000:3.0:1790391358.385630:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391358.385736:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169543424 00000100:00100000:2.0:1790391358.385747:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169543424 00000100:00100000:2.0:1790391358.385801:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 302 00000100:00100000:2.0:1790391358.385811:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:8720:x1877361169543424:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391358.385998:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:8720:x1877361169543424:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 187us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391358.386006:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 302 00000100:00100000:3.0:1790391358.389572:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391358.389676:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169543552 00000100:00100000:0.0:1790391358.389685:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169543552 00000100:00100000:0.0:1790391358.389755:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 303 00000100:00100000:0.0:1790391358.389765:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:8720:x1877361169543552:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391358.389941:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:8720:x1877361169543552:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 177us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.389959:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 303 00000100:00100000:3.0:1790391358.394026:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391358.394323:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169543680 00000100:00100000:2.0:1790391358.394332:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169543680 00000100:00100000:2.0:1790391358.394375:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:2.0:1790391358.394383:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2380:x1877361169543680:12345-192.168.202.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790391358.394413:0:10091:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6b4e828e-5852-4c32-bc74-22a6cf01e473@192.168.202.28@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1790391358.394449:0:10091:0:(genops.c:1385:class_connect()) connect: client 6b4e828e-5852-4c32-bc74-22a6cf01e473, cookie 0x2b1b7949f13e1067 00000004:00100000:2.0:1790391358.394471:0:10091:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790391358.394575:0:10091:0:(import.c:65:import_set_state_nolock()) ffff9e5181cc1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391358.394638:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2380:x1877361169543680:12345-192.168.202.28@tcp:38:mount.lustre.0 Request processed in 253us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391358.394645:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:3.0:1790391358.399063:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391358.399117:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391358.399218:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169543936 00000100:00100000:2.0:1790391358.399241:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169543936 00000100:00100000:2.0:1790391358.399293:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169544448 00000100:00100000:2.0:1790391358.399296:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169544448 00000100:00100000:2.0:1790391358.399349:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 131 00000100:00100000:2.0:1790391358.399359:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169544448:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391358.399434:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169544448:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 76us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391358.399442:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 131 00000100:00100000:2.0:1790391358.399459:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:2.0:1790391358.399463:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2380:x1877361169543936:12345-192.168.202.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790391358.399488:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6b4e828e-5852-4c32-bc74-22a6cf01e473@192.168.202.28@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1790391358.399521:0:6512:0:(genops.c:1385:class_connect()) connect: client 6b4e828e-5852-4c32-bc74-22a6cf01e473, cookie 0x2b1b7949f13e106e 00000004:00100000:2.0:1790391358.399545:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790391358.399649:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9e5181cc5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391358.399676:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2380:x1877361169543936:12345-192.168.202.28@tcp:38:mount.lustre.0 Request processed in 211us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391358.399682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00080000:1.0:1790391358.400165:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391358.402940:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391358.403807:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169544320 00000100:00100000:2.0:1790391358.403820:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169544320 00000100:00080000:1.0:1790391358.403967:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391358.404031:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 132 00000100:00100000:2.0:1790391358.404044:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169544320:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391358.404129:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169544320:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 89us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391358.404137:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 132 00000100:00100000:3.0:1790391358.406938:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391358.412864:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391358.412969:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169544064 00000100:00100000:0.0:1790391358.412979:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169544064 00000100:00100000:0.0:1790391358.413041:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:0.0:1790391358.413051:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:0:x1877361169544064:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391358.413090:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391358.413177:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:0:x1877361169544064:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 127us (6250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.413195:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00080000:0.0:1790391358.419791:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391358.421122:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391358.421310:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169543808 00000100:00100000:0.0:1790391358.421322:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169543808 00000100:00100000:0.0:1790391358.421382:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169544192 00000100:00100000:0.0:1790391358.421386:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169544192 00000100:00100000:0.0:1790391358.421405:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:0.0:1790391358.421414:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+7:0:x1877361169543808:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391358.421456:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790391358.421542:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+7:0:x1877361169543808:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 128us (8687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.421549:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:0.0:1790391358.421566:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:0.0:1790391358.421572:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:8712:x1877361169544192:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391358.421611:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790391358.421637:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:8712:x1877361169544192:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 64us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.421651:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00080000:0.0:1790391358.421668:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391358.424345:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391358.424573:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169544576 00000100:00100000:3.0:1790391358.424583:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169544576 00000100:00100000:3.0:1790391358.424636:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:3.0:1790391358.424647:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:8712:x1877361169544576:12345-192.168.202.28@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790391358.424736:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:8712:x1877361169544576:12345-192.168.202.28@tcp:40:mount.lustre.0 Request processed in 90us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391358.424743:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00010000:00010000:0.0:1790391358.425976:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391358.432250:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391358.432314:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391358.432423:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169544704 00000100:00100000:1.0:1790391358.432432:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169544704 00000100:00100000:1.0:1790391358.432470:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169544832 00000100:00100000:1.0:1790391358.432474:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169544832 00000100:00100000:1.0:1790391358.432502:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:1.0:1790391358.432510:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2380:x1877361169544704:12345-192.168.202.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790391358.432545:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6b4e828e-5852-4c32-bc74-22a6cf01e473@192.168.202.28@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:1.0:1790391358.432575:0:8427:0:(genops.c:1385:class_connect()) connect: client 6b4e828e-5852-4c32-bc74-22a6cf01e473, cookie 0x2b1b7949f13e1075 00002000:00100000:1.0:1790391358.432586:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6b4e828e-5852-4c32-bc74-22a6cf01e473/ffff9e5183330800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790391358.432605:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790391358.432679:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790391358.432722:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9e5183333800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391358.432787:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2380:x1877361169544704:12345-192.168.202.28@tcp:8:mount.lustre.0 Request processed in 276us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.432794:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:1.0:1790391358.432811:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391358.432815:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2380:x1877361169544832:12345-192.168.202.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790391358.432832:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6b4e828e-5852-4c32-bc74-22a6cf01e473@192.168.202.28@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:1.0:1790391358.432867:0:8427:0:(genops.c:1385:class_connect()) connect: client 6b4e828e-5852-4c32-bc74-22a6cf01e473, cookie 0x2b1b7949f13e107c 00002000:00100000:1.0:1790391358.432873:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6b4e828e-5852-4c32-bc74-22a6cf01e473/ffff9e5183331800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790391358.432901:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790391358.432940:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790391358.432957:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9e5183332000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391358.432983:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2380:x1877361169544832:12345-192.168.202.28@tcp:8:mount.lustre.0 Request processed in 166us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.432990:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:3.0:1790391358.435198:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391358.435316:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169544960 00000100:00100000:1.0:1790391358.435327:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169544960 00000100:00100000:1.0:1790391358.435382:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:1.0:1790391358.435391:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:8712:x1877361169544960:12345-192.168.202.28@tcp:900:mount.lustre.0 00000100:00100000:1.0:1790391358.435470:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:8712:x1877361169544960:12345-192.168.202.28@tcp:900:mount.lustre.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391358.435477:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:2.0:1790391358.437241:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391358.437378:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169545088 00000100:00100000:0.0:1790391358.437388:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169545088 00000100:00100000:0.0:1790391358.437453:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:0.0:1790391358.437463:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:8712:x1877361169545088:12345-192.168.202.28@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790391358.437551:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790391358.437639:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:8712:x1877361169545088:12345-192.168.202.28@tcp:33:mount.lustre.0 Request processed in 177us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.437646:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:2.0:1790391358.472217:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186396672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391358.472307:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391358.472589:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186396672 00000100:00100000:3.0:1790391358.472600:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186396672 00000100:00100000:3.0:1790391358.472677:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790391358.472690:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186396672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391358.472735:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391358.472791:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186396672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391358.472798:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1790391358.472923:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76ae680 x1877361186396672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391358.472943:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186396672:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790391358.473072:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391358.473198:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391358.473210:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186396800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391358.473244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391358.473476:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186396800 00000100:00100000:0.0:1790391358.473482:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186396800 00000100:00100000:0.0:1790391358.473525:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790391358.473533:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290bcc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186396800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391358.473553:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391358.473597:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290bcc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186396800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.473604:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790391358.473868:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186396800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391358.474500:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391358.485310:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186396928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391358.485394:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391358.485649:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186396928 00000100:00100000:0.0:1790391358.485658:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186396928 00000100:00100000:0.0:1790391358.485749:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790391358.485778:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186396928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391358.485809:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391358.485872:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186396928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391358.485900:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1790391358.485986:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51833c8700 x1877361186396928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391358.486005:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186396928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790391358.488664:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790391359.434249:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391360.459009:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391360.525387:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391360.525416:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186397056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391360.525485:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391360.527482:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186397056 00000100:00100000:2.0:1790391360.527498:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186397056 00000100:00100000:2.0:1790391360.527559:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790391360.527568:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186397056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391360.527604:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790391360.527699:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186397056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391360.527707:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790391360.527941:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186397056:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790391361.480457:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391362.056374:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186397440:0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.056447:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391362.056503:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186397952:0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.056529:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391362.056547:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186398464:0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.056566:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391362.056591:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790391362.056597:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186397568:0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.056617:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391362.056631:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186398080:0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.056654:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391362.056685:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186398592:0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.056705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391362.056739:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186397952 00000100:00100000:3.0:1790391362.056747:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186397952 00000100:00100000:3.0:1790391362.056796:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186398464 00000100:00100000:3.0:1790391362.056799:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186398464 00000100:00100000:3.0:1790391362.056813:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186397568 00000100:00100000:3.0:1790391362.056816:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186397568 00000100:00100000:3.0:1790391362.056829:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790391362.056837:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186397952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.056931:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186397952:12345-0@lo:400:kworker.0 Request processed in 94us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391362.056939:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790391362.056956:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790391362.056962:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186398464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.056989:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186398464:12345-0@lo:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391362.056995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790391362.057006:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790391362.057012:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186397568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.057038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186397568:12345-0@lo:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391362.057044:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790391362.057060:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186398080 00000100:00100000:3.0:1790391362.057064:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186398080 00000100:00100000:3.0:1790391362.057088:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186398592 00000100:00100000:3.0:1790391362.057091:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186398592 00000100:00100000:3.0:1790391362.057109:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790391362.057115:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186398080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.057218:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186398080:12345-0@lo:400:kworker.0 Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391362.057225:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790391362.057238:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790391362.057244:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186398592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.057341:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186398592:12345-0@lo:400:kworker.0 Request processed in 98us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391362.057356:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790391362.057405:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186397568:0@lo:400:kworker.0 00010000:00080000:3.0:1790391362.057417:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831ba300 x1877361186398080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391362.057426:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186398080:0@lo:400:kworker.0 00010000:00080000:3.0:1790391362.057435:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382aa00 x1877361186398592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391362.057441:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186398592:0@lo:400:kworker.0 00010000:00080000:3.0:1790391362.057449:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831bb800 x1877361186397952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391362.057456:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186397952:0@lo:400:kworker.0 00010000:00080000:3.0:1790391362.057464:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382ad80 x1877361186398464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391362.057470:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186398464:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.057577:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186397312:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.057610:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391362.057638:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186397824:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.057659:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391362.057696:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186398336:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.057719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391362.057733:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1790391362.057740:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186397184:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.057767:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391362.057790:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186397696:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.057812:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391362.057828:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186398208:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.057848:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391362.057862:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186398720:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.057901:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391362.057928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186397312 00000100:00100000:2.0:1790391362.057932:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186397312 00000100:00100000:2.0:1790391362.057952:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186397824 00000100:00100000:2.0:1790391362.057955:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186397824 00000100:00100000:2.0:1790391362.057966:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186398336 00000100:00100000:2.0:1790391362.057970:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186398336 00000100:00100000:2.0:1790391362.057981:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790391362.057986:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186397312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058022:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186397312:12345-0@lo:400:kworker.0 Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.058028:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790391362.058041:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790391362.058046:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186397824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058070:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186397824:12345-0@lo:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.058076:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790391362.058095:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790391362.058100:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186398336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058128:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186398336:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.058133:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790391362.058170:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186398208 00000100:00100000:2.0:1790391362.058173:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186398208 00000100:00100000:2.0:1790391362.058194:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186398720 00000100:00100000:2.0:1790391362.058196:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186398720 00000100:00100000:2.0:1790391362.058210:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391362.058216:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186398208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058244:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186398208:12345-0@lo:400:kworker.0 Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.058263:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391362.058276:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790391362.058283:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186398720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058308:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186398720:12345-0@lo:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.058314:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1790391362.058329:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391362.058333:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391362.058335:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391362.058337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391362.058348:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186397184 00000100:00100000:2.0:1790391362.058352:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186397184 00000100:00100000:2.0:1790391362.058377:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1790391362.058383:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186397184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058412:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186397184:12345-0@lo:400:kworker.0 Request processed in 29us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.058425:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1790391362.058454:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186397440 00000100:00100000:2.0:1790391362.058458:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186397440 00000100:00100000:2.0:1790391362.058481:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186397696 00000100:00100000:2.0:1790391362.058485:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186397696 00000100:00100000:2.0:1790391362.058498:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790391362.058503:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186397440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058540:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186397440:12345-0@lo:400:kworker.0 Request processed in 36us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.058546:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790391362.058557:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790391362.058563:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186397696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058591:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186397696:12345-0@lo:400:kworker.0 Request processed in 27us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.058596:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790391362.058642:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186397184:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058653:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186397696:0@lo:400:kworker.0 00010000:00080000:2.0:1790391362.058664:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831b9c00 x1877361186398208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391362.058684:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186398208:0@lo:400:kworker.0 00010000:00080000:2.0:1790391362.058694:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828a80 x1877361186398720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391362.058702:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186398720:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058712:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186397312:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058731:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186397824:0@lo:400:kworker.0 00000100:00100000:2.0:1790391362.058739:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186398336:0@lo:400:kworker.0 00000100:00100000:3.0:1790391362.059366:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186397440:0@lo:400:kworker.0 00010000:00010000:0.0:1790391362.504197:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391362.568827:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186398848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391362.568931:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391362.570657:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391362.570688:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186398976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391362.570765:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391362.570933:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186398848 00000100:00100000:2.0:1790391362.570942:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186398848 00000100:00100000:2.0:1790391362.570995:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186398976 00000100:00100000:2.0:1790391362.570999:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186398976 00000100:00100000:2.0:1790391362.571014:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790391362.571024:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186398848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391362.571055:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391362.571104:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186398848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (2172us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.571110:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790391362.571126:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790391362.571133:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186398976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790391362.571145:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391362.571171:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186398976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391362.571176:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1790391362.571267:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5181cbad80 x1877361186398976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391362.571287:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186398976:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1790391362.571559:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5181cb8e00 x1877361186398848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391362.571573:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186398848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391363.466713:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391363.466750:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391363.466783:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391363.466807:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391363.466827:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391363.466846:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391363.466866:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391363.466922:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169545472 00000100:00100000:0.0:1790391363.466932:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169545472 00000100:00100000:0.0:1790391363.466981:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169545728 00000100:00100000:0.0:1790391363.466984:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169545728 00000100:00100000:0.0:1790391363.466998:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169545344 00000100:00100000:0.0:1790391363.467009:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169545344 00000100:00100000:0.0:1790391363.467024:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169545600 00000100:00100000:0.0:1790391363.467026:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169545600 00000100:00100000:0.0:1790391363.467043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 139 00000100:00100000:0.0:1790391363.467054:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169545472:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391363.467144:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169545472:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 92us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.467152:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 139 00000100:00100000:0.0:1790391363.467169:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 140 00000100:00100000:0.0:1790391363.467176:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2383:x1877361169545728:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391363.467202:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2383:x1877361169545728:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.467209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 140 00000100:00100000:0.0:1790391363.467220:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 141 00000100:00100000:0.0:1790391363.467226:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169545344:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391363.467250:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169545344:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.467257:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 141 00000100:00100000:0.0:1790391363.467267:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 142 00000100:00100000:0.0:1790391363.467274:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2383:x1877361169545600:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391363.467296:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2383:x1877361169545600:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.467302:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 142 00000100:00100000:0.0:1790391363.467320:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169545984 00000100:00100000:0.0:1790391363.467329:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169545984 00000100:00100000:0.0:1790391363.467358:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169545856 00000100:00100000:0.0:1790391363.467360:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169545856 00000100:00100000:0.0:1790391363.467381:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:0.0:1790391363.467387:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2383:x1877361169545984:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391363.467415:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2383:x1877361169545984:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 28us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.467421:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:0.0:1790391363.467431:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:0.0:1790391363.467437:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2383:x1877361169545856:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391363.467458:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2383:x1877361169545856:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 22us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391363.467463:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00080000:0.0:1790391363.467483:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391363.467487:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391363.467490:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391363.467492:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391363.468641:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169545216 00000100:00100000:1.0:1790391363.468651:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169545216 00000100:00100000:1.0:1790391363.468709:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 305 00000100:00100000:1.0:1790391363.468717:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169545216:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391363.468770:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169545216:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 53us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391363.468776:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 305 00010000:00010000:2.0:1790391363.529298:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391363.595744:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391363.595770:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186399104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391363.595848:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391363.596138:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186399104 00000100:00100000:2.0:1790391363.596147:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186399104 00000100:00100000:2.0:1790391363.596198:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391363.596208:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186399104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391363.596237:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391363.596285:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186399104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391363.596308:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790391363.596460:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391363.596470:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186399232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391363.596499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391363.596532:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186399232 00000100:00100000:3.0:1790391363.596541:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186399232 00000100:00100000:3.0:1790391363.596569:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790391363.596575:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186399232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391363.596599:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391363.596633:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186399232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391363.596639:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1790391363.596686:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76af800 x1877361186399232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391363.596705:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186399232:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1790391363.596737:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5181cb9500 x1877361186399104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391363.596749:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186399104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391363.597391:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391363.597403:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186399360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391363.597440:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391363.597475:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186399360 00000100:00100000:3.0:1790391363.597480:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186399360 00000100:00100000:3.0:1790391363.597511:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790391363.597518:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186399360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391363.597544:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790391363.597733:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186399360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391363.597741:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790391363.597780:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186399360:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1790391364.347751:0:12181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1790391364.552369:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790391364.620923:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6b4e828e-5852-4c32-bc74-22a6cf01e473 00000001:00100000:0.0:1790391364.621004:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6b4e828e-5852-4c32-bc74-22a6cf01e473 00000001:00100000:1.0:1790391364.621512:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6b4e828e-5852-4c32-bc74-22a6cf01e473 00000001:00100000:3.0:1790391364.622023:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6b4e828e-5852-4c32-bc74-22a6cf01e473 00010000:00010000:2.0:1790391365.576138:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391365.640026:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391365.640064:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186399488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391365.640130:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391365.640195:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186399488 00000100:00100000:3.0:1790391365.640204:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186399488 00000100:00100000:3.0:1790391365.640258:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790391365.640267:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186399488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391365.640304:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790391365.640353:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186399488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391365.640361:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790391365.640380:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186399488:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790391366.601251:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391367.176188:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186399616:0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.176272:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391367.176378:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186399616 00000100:00100000:2.0:1790391367.176385:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186399616 00000100:00100000:2.0:1790391367.176436:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1790391367.176445:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186399616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391367.178025:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186399616:12345-0@lo:400:kworker.0 Request processed in 1574us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.178037:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1790391367.178094:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186399872:0@lo:400:kworker.0 00000100:00100000:2.0:1790391367.178151:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391367.178188:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391367.178195:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186399744:0@lo:400:kworker.0 00000100:00100000:0.0:1790391367.178306:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186399872 00000100:00100000:0.0:1790391367.178313:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186399872 00000100:00100000:0.0:1790391367.178357:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790391367.178366:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186399872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391367.178415:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186399872:12345-0@lo:400:kworker.0 Request processed in 50us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391367.178421:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790391367.178595:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391367.178649:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186399872:0@lo:400:kworker.0 00000100:00100000:0.0:1790391367.178771:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186399744 00000100:00100000:0.0:1790391367.178789:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186399744 00000100:00100000:0.0:1790391367.178822:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790391367.178829:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186399744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391367.178904:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186399744:12345-0@lo:400:kworker.0 Request processed in 47us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391367.178910:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790391367.178934:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186399744:0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.179547:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186399616:0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.179573:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391367.179582:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186400000:0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.179614:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391367.179794:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186400000 00000100:00100000:0.0:1790391367.179799:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186400000 00000100:00100000:2.0:1790391367.180055:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790391367.180065:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186400000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391367.180127:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186400000:12345-0@lo:400:kworker.0 Request processed in 63us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391367.180134:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790391367.180381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186400000:0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.181590:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186400256:0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.181718:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186400128:0@lo:400:kworker.0 00000100:00100000:0.0:1790391367.181849:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186400512:0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.183026:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391367.183064:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186400640:0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.183218:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391367.183240:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186401152:0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.183263:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391367.183308:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186400128 00000100:00100000:1.0:1790391367.183317:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186400128 00000100:00100000:1.0:1790391367.183363:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391367.183372:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186400128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.183427:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186400128:12345-0@lo:400:kworker.0 Request processed in 55us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.183434:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391367.183455:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186400640 00000100:00100000:1.0:1790391367.183458:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186400640 00000100:00100000:1.0:1790391367.185016:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186401152 00000100:00100000:1.0:1790391367.185028:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186401152 00000100:00100000:1.0:1790391367.185058:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790391367.185067:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186400640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.185147:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186400640:12345-0@lo:400:kworker.0 Request processed in 80us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.185154:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790391367.185169:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790391367.185174:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186401152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.185203:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186401152:12345-0@lo:400:kworker.0 Request processed in 29us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.185326:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1790391367.185349:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391367.185353:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391367.185398:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186400128:0@lo:400:kworker.0 00010000:00080000:1.0:1790391367.185423:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76af800 x1877361186400640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391367.185434:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186400640:0@lo:400:kworker.0 00010000:00080000:1.0:1790391367.185444:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76ae680 x1877361186401152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391367.185453:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186401152:0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.186009:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391367.186048:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186400768:0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.186079:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391367.186112:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790391367.186119:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186400384:0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.186141:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391367.186158:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186400896:0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.186176:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391367.186201:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186400256 00000100:00100000:3.0:1790391367.186217:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186400256 00000100:00100000:3.0:1790391367.186247:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186400768 00000100:00100000:3.0:1790391367.186250:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186400768 00000100:00100000:3.0:1790391367.186264:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186400384 00000100:00100000:3.0:1790391367.186266:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186400384 00000100:00100000:3.0:1790391367.186278:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186400896 00000100:00100000:3.0:1790391367.186281:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186400896 00000100:00100000:3.0:1790391367.186296:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790391367.186311:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186400256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.186349:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186400256:12345-0@lo:400:kworker.0 Request processed in 39us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391367.186355:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790391367.186370:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790391367.186375:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186400768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.186401:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186400768:12345-0@lo:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391367.186407:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790391367.186416:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790391367.186421:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186400384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.186446:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186400384:12345-0@lo:400:kworker.0 Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391367.186452:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790391367.186461:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790391367.186467:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186400896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.186728:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186400896:12345-0@lo:400:kworker.0 Request processed in 260us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391367.186734:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00080000:3.0:1790391367.186773:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76aed80 x1877361186400384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391367.186783:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186400384:0@lo:400:kworker.0 00010000:00080000:3.0:1790391367.186793:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76ace00 x1877361186400896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391367.186810:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186400896:0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.186824:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186400256:0@lo:400:kworker.0 00000100:00100000:3.0:1790391367.186833:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186400768:0@lo:400:kworker.0 00000100:00080000:1.0:1790391367.188789:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391367.188798:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391367.199358:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391367.199412:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186401024:0@lo:400:kworker.0 00000100:00100000:0.0:1790391367.199452:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391367.199592:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186400512 00000100:00100000:1.0:1790391367.199601:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186400512 00000100:00100000:1.0:1790391367.199664:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186401024 00000100:00100000:1.0:1790391367.199667:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186401024 00000100:00100000:1.0:1790391367.199685:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790391367.199694:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186400512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.199817:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186400512:12345-0@lo:400:kworker.0 Request processed in 123us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.199824:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790391367.199839:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790391367.199844:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186401024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391367.199864:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186401024:12345-0@lo:400:kworker.0 Request processed in 20us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391367.199869:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1790391367.199915:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391367.199919:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790391367.200046:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76adf80 x1877361186401024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391367.200060:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186401024:0@lo:400:kworker.0 00010000:00080000:0.0:1790391367.200088:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76adc00 x1877361186400512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391367.200536:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186400512:0@lo:400:kworker.0 00010000:00010000:1.0:1790391367.626375:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391367.694647:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186401280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391367.694729:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391367.694791:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391367.694798:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186401408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391367.694820:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391367.702976:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186401280 00000100:00100000:3.0:1790391367.702991:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186401280 00000100:00100000:3.0:1790391367.703050:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186401408 00000100:00100000:3.0:1790391367.703053:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186401408 00000100:00100000:3.0:1790391367.703071:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790391367.703081:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186401280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790391367.703113:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391367.703204:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186401280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (8475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391367.703211:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790391367.703242:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790391367.703248:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186401408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391367.703258:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391367.703281:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186401408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (8461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391367.703287:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1790391367.703335:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5181cbad80 x1877361186401408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391367.703355:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186401408:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1790391367.703366:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831b8a80 x1877361186401280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391367.703386:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186401280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391368.609521:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391368.609564:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391368.609596:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391368.609633:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391368.609652:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391368.609670:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391368.609688:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391368.609714:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169546368 00000100:00100000:3.0:1790391368.609722:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169546368 00000100:00100000:3.0:1790391368.609773:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169546624 00000100:00100000:3.0:1790391368.609776:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169546624 00000100:00100000:3.0:1790391368.609789:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169546240 00000100:00100000:3.0:1790391368.609791:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169546240 00000100:00100000:3.0:1790391368.609802:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169546496 00000100:00100000:3.0:1790391368.609803:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169546496 00000100:00100000:3.0:1790391368.609816:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 149 00000100:00100000:3.0:1790391368.609825:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169546368:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391368.609925:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169546368:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 100us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.609932:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 149 00000100:00100000:3.0:1790391368.609950:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 150 00000100:00100000:3.0:1790391368.609956:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169546624:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391368.609981:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169546624:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.609987:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 150 00000100:00100000:3.0:1790391368.610012:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 151 00000100:00100000:3.0:1790391368.610018:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169546240:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391368.610044:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169546240:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.610050:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 151 00000100:00100000:3.0:1790391368.610061:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 152 00000100:00100000:3.0:1790391368.610067:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169546496:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391368.610091:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169546496:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.610097:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 152 00000100:00100000:3.0:1790391368.610122:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169546880 00000100:00100000:3.0:1790391368.610126:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169546880 00000100:00100000:3.0:1790391368.610151:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169546752 00000100:00100000:3.0:1790391368.610154:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169546752 00000100:00100000:3.0:1790391368.610173:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 72 00000100:00100000:3.0:1790391368.610179:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169546880:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391368.610217:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169546880:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 38us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.610223:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 72 00000100:00100000:3.0:1790391368.610236:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 73 00000100:00100000:3.0:1790391368.610243:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169546752:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391368.610268:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169546752:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.610274:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 73 00000100:00080000:3.0:1790391368.610302:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391368.610306:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391368.610308:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391368.610310:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391368.610550:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169546112 00000100:00100000:2.0:1790391368.610555:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169546112 00000100:00100000:2.0:1790391368.610595:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 307 00000100:00100000:2.0:1790391368.610603:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169546112:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391368.610665:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169546112:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 62us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391368.610672:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 307 00010000:00010000:1.0:1790391368.649747:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391368.712158:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186401536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391368.712234:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391368.712717:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186401792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391368.712757:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391368.712851:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186401792 00000100:00100000:2.0:1790391368.712859:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186401792 00000100:00100000:2.0:1790391368.712946:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790391368.712956:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b78d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186401792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391368.712986:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391368.713037:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b78d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186401792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391368.713044:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1790391368.713249:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5181cbad80 x1877361186401792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391368.713267:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186401792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391368.713556:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391368.713565:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186401664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391368.713599:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391368.713687:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186401536 00000100:00100000:1.0:1790391368.713693:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186401536 00000100:00100000:1.0:1790391368.713728:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790391368.713735:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186401536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391368.713757:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790391368.713793:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186401536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391368.713800:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790391368.713838:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186401536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391368.716547:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186401664 00000100:00100000:2.0:1790391368.716562:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186401664 00000100:00100000:3.0:1790391368.719614:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790391368.719630:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186401664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391368.719657:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391368.719797:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186401664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 170us (6196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391368.719804:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1790391368.721827:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51833cad80 x1877361186401664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391368.721852:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186401664:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790391369.674790:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391370.696116:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391370.764783:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186401920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391370.764864:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391370.771820:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186401920 00000100:00100000:2.0:1790391370.771836:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186401920 00000100:00100000:2.0:1790391370.771915:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790391370.771926:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186401920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391370.771965:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790391370.772056:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186401920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (7190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391370.772080:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790391370.773970:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186401920:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1790391370.880644:0:12497:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391370.880914:0:12497:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790391371.721613:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391372.296015:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186402048:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.296103:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391372.296187:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186402048 00000100:00100000:2.0:1790391372.296195:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186402048 00000100:00100000:2.0:1790391372.296241:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1790391372.296249:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186402048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391372.300421:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186402048:12345-0@lo:400:kworker.0 Request processed in 4162us (4307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391372.300436:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1790391372.300664:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186402048:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.300687:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391372.300697:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186402176:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.300748:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391372.301248:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186402560:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.301283:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391372.301315:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391372.301322:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186402688:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.301345:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391372.301410:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186403200:0@lo:400:kworker.0 00000100:00100000:3.0:1790391372.301441:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186402304:0@lo:400:kworker.0 00000100:00100000:3.0:1790391372.301460:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391372.301480:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186402816:0@lo:400:kworker.0 00000100:00100000:3.0:1790391372.301503:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186402432:0@lo:400:kworker.0 00000100:00100000:3.0:1790391372.301529:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186402560 00000100:00100000:3.0:1790391372.301534:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186402560 00000100:00100000:3.0:1790391372.301569:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186402304 00000100:00100000:3.0:1790391372.301571:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186402304 00000100:00100000:3.0:1790391372.301598:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790391372.301604:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186402560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391372.301657:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186402560:12345-0@lo:400:kworker.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391372.301676:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790391372.301692:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790391372.301698:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186402304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391372.301731:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186402304:12345-0@lo:400:kworker.0 Request processed in 34us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391372.301737:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790391372.306088:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186402560:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.306131:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186403072:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.307194:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391372.307230:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186403584:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.307258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391372.307301:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391372.307399:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186402176 00000100:00100000:2.0:1790391372.307406:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186402176 00000100:00100000:2.0:1790391372.307456:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186402688 00000100:00100000:2.0:1790391372.307459:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186402688 00000100:00100000:2.0:1790391372.307494:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790391372.307503:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186402176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391372.307562:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186402176:12345-0@lo:400:kworker.0 Request processed in 60us (6814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391372.307570:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790391372.307599:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790391372.307606:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186402688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391372.307659:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186402688:12345-0@lo:400:kworker.0 Request processed in 54us (6313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391372.307665:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790391372.307683:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186403072 00000100:00100000:2.0:1790391372.307688:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186403072 00000100:00100000:2.0:1790391372.307711:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186403584 00000100:00100000:2.0:1790391372.307722:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186403584 00000100:00100000:2.0:1790391372.307747:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790391372.307753:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186403072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391372.307792:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186403072:12345-0@lo:400:kworker.0 Request processed in 39us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391372.307798:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790391372.307810:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790391372.307816:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186403584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391372.307845:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186403584:12345-0@lo:400:kworker.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391372.307851:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1790391372.307866:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391372.307870:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391372.307872:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391372.314471:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186402944:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.314536:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391372.314558:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186403456:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.314596:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391372.314641:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391372.314674:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186402432 00000100:00100000:1.0:1790391372.314682:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186402432 00000100:00100000:1.0:1790391372.314715:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186403200 00000100:00100000:1.0:1790391372.314718:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186403200 00000100:00100000:1.0:1790391372.314763:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790391372.314782:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186402432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.314836:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186402432:12345-0@lo:400:kworker.0 Request processed in 55us (7534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391372.314843:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790391372.314859:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790391372.314865:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186403200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.314914:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186403200:12345-0@lo:400:kworker.0 Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391372.314920:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790391372.314938:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186402944 00000100:00100000:1.0:1790391372.314942:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186402944 00000100:00100000:1.0:1790391372.314965:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186403456 00000100:00100000:1.0:1790391372.314967:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186403456 00000100:00100000:1.0:1790391372.314985:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790391372.314991:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186402944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.315019:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186402944:12345-0@lo:400:kworker.0 Request processed in 28us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391372.315025:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790391372.315035:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790391372.315040:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186403456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.317865:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186403456:12345-0@lo:400:kworker.0 Request processed in 2816us (3260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391372.317943:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1790391372.317981:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391372.317986:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391372.317989:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391372.318042:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186402432:0@lo:400:kworker.0 00010000:00080000:1.0:1790391372.318124:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a5500 x1877361186402944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391372.318137:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186402944:0@lo:400:kworker.0 00010000:00080000:1.0:1790391372.318148:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a4e00 x1877361186403456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391372.318212:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186403456:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.318260:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186403200:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.318288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391372.318367:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186403328:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.318399:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790391372.321354:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a6d80 x1877361186403072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391372.321372:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186403072:0@lo:400:kworker.0 00010000:00080000:0.0:1790391372.321387:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a4a80 x1877361186403584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391372.321418:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186403584:0@lo:400:kworker.0 00000100:00100000:0.0:1790391372.321435:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186402688:0@lo:400:kworker.0 00000100:00100000:0.0:1790391372.321446:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186402176:0@lo:400:kworker.0 00000100:00100000:1.0:1790391372.321743:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186402304:0@lo:400:kworker.0 00000100:00100000:3.0:1790391372.330393:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186402816 00000100:00100000:3.0:1790391372.330407:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186402816 00000100:00080000:1.0:1790391372.330818:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391372.330922:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186403328 00000100:00100000:2.0:1790391372.330927:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186403328 00000100:00080000:1.0:1790391372.330990:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391372.331040:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790391372.331053:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186402816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391372.331161:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186402816:12345-0@lo:400:kworker.0 Request processed in 112us (12872us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391372.331168:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790391372.331185:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790391372.331192:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186403328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391372.331222:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186403328:12345-0@lo:400:kworker.0 Request processed in 31us (12822us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391372.331228:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00010000:00080000:1.0:1790391372.331301:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76afb80 x1877361186402816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391372.331317:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186402816:0@lo:400:kworker.0 00010000:00080000:1.0:1790391372.331330:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a4700 x1877361186403328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391372.331338:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186403328:0@lo:400:kworker.0 00010000:00010000:1.0:1790391372.749235:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391372.809993:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186403712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391372.810070:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391372.810172:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186403712 00000100:00100000:3.0:1790391372.810179:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186403712 00000100:00100000:3.0:1790391372.810226:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391372.810236:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186403712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790391372.810280:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391372.810325:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186403712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391372.810333:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1790391372.810373:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a7800 x1877361186403712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391372.810390:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186403712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391372.810981:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186403840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391372.811023:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391372.811062:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186403840 00000100:00100000:1.0:1790391372.811066:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186403840 00000100:00100000:1.0:1790391372.811108:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790391372.811115:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186403840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391372.811128:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391372.811173:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186403840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391372.811180:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1790391372.811208:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77eb480 x1877361186403840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391372.811221:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186403840:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1790391372.873802:0:12595:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391372.874440:0:12595:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1790391373.702992:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391373.703069:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391373.703149:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169547136 00000100:00100000:0.0:1790391373.703160:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169547136 00000100:00100000:0.0:1790391373.703227:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169547392 00000100:00100000:0.0:1790391373.703240:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169547392 00000100:00100000:0.0:1790391373.703268:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 159 00000100:00100000:0.0:1790391373.703289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169547136:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391373.703377:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169547136:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 92us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391373.703386:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 159 00000100:00100000:0.0:1790391373.703404:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 160 00000100:00100000:0.0:1790391373.703422:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169547392:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391373.703449:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169547392:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391373.703456:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 160 00000100:00080000:3.0:1790391373.703734:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391373.703770:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391373.703911:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391373.703972:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391373.703993:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391373.704013:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391373.704034:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169547648 00000100:00100000:3.0:1790391373.704039:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169547648 00000100:00100000:3.0:1790391373.704074:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169547776 00000100:00100000:3.0:1790391373.704077:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169547776 00000100:00100000:3.0:1790391373.704098:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 78 00000100:00100000:3.0:1790391373.704106:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169547648:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391373.704144:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169547648:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391373.704151:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 78 00000100:00100000:3.0:1790391373.704164:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 79 00000100:00100000:3.0:1790391373.704170:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169547776:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391373.704194:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169547776:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391373.704200:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 79 00000100:00100000:3.0:1790391373.704218:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169547008 00000100:00100000:3.0:1790391373.704221:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169547008 00000100:00100000:1.0:1790391373.704412:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169547264 00000100:00100000:1.0:1790391373.704415:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169547264 00000100:00100000:1.0:1790391373.704442:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169547520 00000100:00100000:1.0:1790391373.704445:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169547520 00000100:00100000:1.0:1790391373.704461:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 161 00000100:00100000:1.0:1790391373.704467:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169547264:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391373.704492:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169547264:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 26us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391373.704496:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 161 00000100:00100000:1.0:1790391373.704505:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 162 00000100:00100000:1.0:1790391373.704508:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169547520:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391373.704520:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169547520:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 12us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391373.704533:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 162 00000100:00100000:3.0:1790391373.704693:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 309 00000100:00100000:3.0:1790391373.704700:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169547008:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391373.704725:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169547008:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 26us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391373.704732:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 309 00000100:00080000:3.0:1790391373.704766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391373.704775:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391373.704777:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391373.768062:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391373.835477:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186403968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391373.835545:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391373.835643:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186403968 00000100:00100000:1.0:1790391373.835651:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186403968 00000100:00100000:1.0:1790391373.835697:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790391373.835707:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186403968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790391373.835739:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391373.835785:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186403968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391373.835792:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1790391373.835834:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a6300 x1877361186403968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391373.835853:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186403968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391373.836063:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391373.836074:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186404096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391373.836110:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391373.836152:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186404096 00000100:00100000:2.0:1790391373.836157:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186404096 00000100:00100000:2.0:1790391373.836187:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790391373.836194:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186404096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391373.836217:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790391373.836251:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186404096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391373.836272:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790391373.836307:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186404096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391373.836605:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391373.836616:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186404224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391373.836645:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391373.836716:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186404224 00000100:00100000:0.0:1790391373.836721:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186404224 00000100:00100000:0.0:1790391373.836755:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790391373.836763:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186404224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391373.836775:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391373.836807:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186404224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391373.836813:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1790391373.836911:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51833cad80 x1877361186404224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391373.836926:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186404224:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790391374.792810:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790391374.868440:0:12692:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391374.868699:0:12692:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790391375.816185:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391375.880211:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391375.880234:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186404352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391375.880314:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391375.880385:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186404352 00000100:00100000:1.0:1790391375.880393:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186404352 00000100:00100000:1.0:1790391375.880448:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790391375.880457:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186404352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391375.880489:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790391375.880552:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186404352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391375.880559:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790391375.880753:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186404352:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1790391376.743370:0:12789:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391376.743696:0:12789:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790391376.845319:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391377.426440:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186404480:0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.426536:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391377.427101:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186404992:0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.427148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391377.427171:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186405504:0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.427197:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391377.427224:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790391377.427230:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186404864:0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.427255:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391377.427271:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186405376:0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.427294:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391377.427312:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186405888:0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.427332:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391377.427382:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186405504 00000100:00100000:1.0:1790391377.427390:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186405504 00000100:00100000:1.0:1790391377.427442:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186405376 00000100:00100000:1.0:1790391377.427445:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186405376 00000100:00100000:1.0:1790391377.427463:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186405888 00000100:00100000:1.0:1790391377.427465:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186405888 00000100:00100000:1.0:1790391377.427492:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790391377.427499:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186405504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.427556:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186405504:12345-0@lo:400:kworker.0 Request processed in 57us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391377.427563:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790391377.427576:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790391377.427582:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186405376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.427605:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186405376:12345-0@lo:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391377.427611:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790391377.427619:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790391377.427624:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186405888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.427644:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186405888:12345-0@lo:400:kworker.0 Request processed in 20us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391377.427649:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790391377.427664:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186404864 00000100:00100000:1.0:1790391377.427666:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186404864 00000100:00100000:1.0:1790391377.427688:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790391377.427694:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186404864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.427720:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186404864:12345-0@lo:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391377.427725:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1790391377.427745:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391377.427749:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391377.427784:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186404864:0@lo:400:kworker.0 00010000:00080000:1.0:1790391377.427795:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51839f5180 x1877361186405376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391377.427811:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186405376:0@lo:400:kworker.0 00010000:00080000:1.0:1790391377.427820:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183829f80 x1877361186405888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391377.427829:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186405888:0@lo:400:kworker.0 00010000:00080000:1.0:1790391377.427836:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382a680 x1877361186405504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391377.427843:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186405504:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.428421:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186404608:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.428455:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391377.428478:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186405120:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.428499:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391377.428515:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186405632:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.428546:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391377.428567:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790391377.428573:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186404736:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.428595:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391377.428612:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186405248:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.428632:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391377.428648:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186405760:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.428666:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391377.428691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186404480 00000100:00100000:2.0:1790391377.428696:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186404480 00000100:00100000:2.0:1790391377.428728:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1790391377.428735:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186404480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.428769:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186404480:12345-0@lo:400:kworker.0 Request processed in 35us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391377.428787:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1790391377.428816:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186404992 00000100:00100000:2.0:1790391377.428820:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186404992 00000100:00100000:2.0:1790391377.428838:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186404736 00000100:00100000:2.0:1790391377.428841:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186404736 00000100:00100000:2.0:1790391377.428851:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790391377.428856:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186404992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.428913:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186404992:12345-0@lo:400:kworker.0 Request processed in 57us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391377.428920:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790391377.428990:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790391377.428996:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186404736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.429095:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186404736:12345-0@lo:400:kworker.0 Request processed in 98us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391377.429101:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790391377.429206:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391377.429217:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186406016:0@lo:400:kworker.0 00000100:00100000:3.0:1790391377.429247:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391377.429321:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186406016 00000100:00100000:1.0:1790391377.429325:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186406016 00000100:00100000:1.0:1790391377.429369:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790391377.429374:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186406016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391377.429408:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186406016:12345-0@lo:400:kworker.0 Request processed in 34us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391377.429414:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1790391377.429446:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828a80 x1877361186406016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391377.429457:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186406016:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.429920:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186404608 00000100:00100000:2.0:1790391377.429997:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186404608 00000100:00100000:2.0:1790391377.430083:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186405120 00000100:00100000:2.0:1790391377.430087:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186405120 00000100:00100000:2.0:1790391377.430100:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186405632 00000100:00100000:2.0:1790391377.430102:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186405632 00000100:00100000:2.0:1790391377.430231:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186405248 00000100:00100000:2.0:1790391377.430235:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186405248 00000100:00100000:2.0:1790391377.430245:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186405760 00000100:00100000:2.0:1790391377.430247:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186405760 00000100:00100000:2.0:1790391377.430258:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790391377.430263:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186404608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.430301:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186404608:12345-0@lo:400:kworker.0 Request processed in 37us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391377.430317:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790391377.430327:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790391377.430332:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186405120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.430368:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186405120:12345-0@lo:400:kworker.0 Request processed in 35us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391377.430374:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790391377.430383:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790391377.430388:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186405632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.430409:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186405632:12345-0@lo:400:kworker.0 Request processed in 22us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391377.430414:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790391377.430421:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790391377.430426:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186405248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.430448:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186405248:12345-0@lo:400:kworker.0 Request processed in 21us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391377.430452:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790391377.430460:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790391377.430464:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186405760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.430481:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186405760:12345-0@lo:400:kworker.0 Request processed in 17us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391377.430485:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790391377.430538:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186404736:0@lo:400:kworker.0 00010000:00080000:2.0:1790391377.430550:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51839f7b80 x1877361186405248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391377.430570:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186405248:0@lo:400:kworker.0 00010000:00080000:2.0:1790391377.430582:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828000 x1877361186405760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391377.430591:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186405760:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.430602:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186404608:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.430611:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186405120:0@lo:400:kworker.0 00000100:00100000:2.0:1790391377.430621:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186405632:0@lo:400:kworker.0 00000100:00080000:3.0:1790391377.430760:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391377.430764:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391377.430767:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391377.431146:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186404480:0@lo:400:kworker.0 00000100:00100000:0.0:1790391377.431159:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186404992:0@lo:400:kworker.0 00010000:00010000:2.0:1790391377.869186:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391377.928292:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186406144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391377.928361:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391377.928464:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186406144 00000100:00100000:0.0:1790391377.928471:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186406144 00000100:00100000:0.0:1790391377.928530:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790391377.928540:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186406144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391377.928570:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391377.928740:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186406144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391377.928759:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1790391377.933645:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831de680 x1877361186406144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391377.933675:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186406144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391377.933703:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391377.933714:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186406272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391377.933769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391377.934273:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186406272 00000100:00100000:0.0:1790391377.934281:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186406272 00000100:00100000:0.0:1790391377.934333:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790391377.934342:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186406272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391377.934365:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391377.934411:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186406272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391377.934418:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1790391377.935540:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a5500 x1877361186406272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391377.935562:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186406272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391378.824345:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391378.824468:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169548544 00000100:00100000:3.0:1790391378.824477:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169548544 00000100:00100000:3.0:1790391378.824554:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:3.0:1790391378.824565:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2380:x1877361169548544:12345-192.168.202.28@tcp:9:kworker.0 00000020:00000080:3.0:1790391378.824592:0:10505:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e1075 00000100:00080000:3.0:1790391378.824601:0:10505:0:(import.c:65:import_set_state_nolock()) ffff9e5183333800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790391378.824657:0:10505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1790391378.824805:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6b4e828e-5852-4c32-bc74-22a6cf01e473+2:2380:x1877361169548544:12345-192.168.202.28@tcp:9:kworker.0 Request processed in 242us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391378.824813:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00010000:00010000:3.0:1790391378.824837:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391378.826456:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391378.837981:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391378.838026:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391378.838055:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391378.838076:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391378.838106:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391378.838134:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391378.838166:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169548032 00000100:00100000:0.0:1790391378.838175:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169548032 00000100:00100000:0.0:1790391378.838227:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169548288 00000100:00100000:0.0:1790391378.838231:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169548288 00000100:00100000:0.0:1790391378.838244:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169548160 00000100:00100000:0.0:1790391378.838247:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169548160 00000100:00100000:0.0:1790391378.838257:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169548416 00000100:00100000:0.0:1790391378.838259:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169548416 00000100:00100000:0.0:1790391378.838275:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 169 00000100:00100000:0.0:1790391378.838283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169548032:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391378.838350:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169548032:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 67us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391378.838374:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 169 00000100:00100000:0.0:1790391378.838392:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 170 00000100:00100000:0.0:1790391378.838398:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169548288:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391378.838423:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169548288:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391378.838428:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 170 00000100:00100000:0.0:1790391378.838436:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 171 00000100:00100000:0.0:1790391378.838442:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169548160:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391378.838846:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169548160:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 403us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391378.838853:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 171 00000100:00100000:0.0:1790391378.838868:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 172 00000100:00100000:0.0:1790391378.838874:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169548416:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391378.838921:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169548416:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 48us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391378.838926:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 172 00000100:00100000:0.0:1790391378.838954:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169548672 00000100:00100000:0.0:1790391378.838957:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169548672 00000100:00100000:0.0:1790391378.838998:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:0.0:1790391378.839005:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2380:x1877361169548672:12345-192.168.202.28@tcp:9:kworker.0 00000020:00000080:0.0:1790391378.839025:0:9796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e107c 00000100:00080000:0.0:1790391378.839033:0:9796:0:(import.c:65:import_set_state_nolock()) ffff9e5183332000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790391378.839077:0:9796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1790391378.839217:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+2:2380:x1877361169548672:12345-192.168.202.28@tcp:9:kworker.0 Request processed in 211us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391378.839223:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 23 00010000:00010000:0.0:1790391378.839243:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391378.839250:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391378.839254:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391378.839256:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391378.840358:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169547904 00000100:00100000:3.0:1790391378.840375:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169547904 00000100:00100000:3.0:1790391378.840430:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 311 00000100:00100000:3.0:1790391378.840438:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169547904:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391378.840777:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169547904:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 338us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391378.840785:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 311 00000020:00000004:0.0:1790391378.877086:0:12886:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391378.881185:0:12886:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790391378.888075:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391378.952711:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186406528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391378.952784:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391378.952926:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391378.952934:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186406400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391378.952959:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391378.960954:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186406656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391378.961022:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391378.961085:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186406656 00000100:00100000:1.0:1790391378.961105:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186406656 00000100:00100000:1.0:1790391378.961153:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790391378.961163:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186406656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391378.961204:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790391378.961262:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186406656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391378.961269:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790391378.961315:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186406656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391378.966981:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186406528 00000100:00100000:2.0:1790391378.966996:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186406528 00000100:00100000:2.0:1790391378.970040:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186406400 00000100:00100000:2.0:1790391378.970052:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186406400 00000100:00100000:2.0:1790391378.970075:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790391378.970083:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186406528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391378.970115:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391378.970183:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186406528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (17399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391378.970190:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790391378.970204:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790391378.970549:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186406400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391378.970562:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391378.970587:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186406400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 378us (17628us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391378.970593:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1790391378.970720:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a5500 x1877361186406400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391378.970749:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186406400:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1790391378.970763:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229f100 x1877361186406528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391378.970774:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186406528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790391379.912080:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391380.942218:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391381.001237:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391381.001267:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186406784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391381.001357:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391381.001685:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186406784 00000100:00100000:1.0:1790391381.001696:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186406784 00000100:00100000:1.0:1790391381.001761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790391381.001771:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186406784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391381.001817:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790391381.001898:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186406784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391381.001905:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790391381.001950:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186406784:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790391381.965208:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391382.405756:0:13031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1790391382.539052:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186406912:0@lo:400:kworker.0 00000100:00100000:3.0:1790391382.539148:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391382.539211:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186407424:0@lo:400:kworker.0 00000100:00100000:3.0:1790391382.539237:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391382.539257:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186407936:0@lo:400:kworker.0 00000100:00100000:3.0:1790391382.539280:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391382.539303:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790391382.539323:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186407040:0@lo:400:kworker.0 00000100:00100000:3.0:1790391382.539764:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391382.539787:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186407552:0@lo:400:kworker.0 00000100:00100000:3.0:1790391382.539811:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391382.539829:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186408064:0@lo:400:kworker.0 00000100:00100000:3.0:1790391382.539849:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391382.540296:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391382.540426:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186408448:0@lo:400:kworker.0 00000100:00100000:0.0:1790391382.540460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391382.540515:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186407296:0@lo:400:kworker.0 00000100:00100000:0.0:1790391382.540539:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391382.540557:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186407808:0@lo:400:kworker.0 00000100:00100000:0.0:1790391382.540747:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391382.541332:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186408320:0@lo:400:kworker.0 00000100:00100000:0.0:1790391382.541364:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391382.542950:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186407168:0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.543012:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391382.543043:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186407680:0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.543080:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391382.543092:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186408192:0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.543111:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391382.543146:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186407424 00000100:00100000:1.0:1790391382.543154:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186407424 00000100:00100000:1.0:1790391382.543424:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186407168 00000100:00100000:1.0:1790391382.543428:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186407168 00000100:00100000:1.0:1790391382.543459:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790391382.543468:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186407424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.543542:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186407424:12345-0@lo:400:kworker.0 Request processed in 74us (4303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391382.543549:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790391382.543565:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790391382.543760:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186406912 00000100:00100000:2.0:1790391382.543765:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186406912 00000100:00100000:2.0:1790391382.543798:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1790391382.543805:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186406912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391382.543844:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186406912:12345-0@lo:400:kworker.0 Request processed in 40us (4696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391382.543850:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1790391382.544539:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186407168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.544729:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186407168:12345-0@lo:400:kworker.0 Request processed in 196us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391382.544735:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790391382.544809:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186407168:0@lo:400:kworker.0 00000100:00100000:2.0:1790391382.545375:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186407040 00000100:00100000:2.0:1790391382.545382:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186407040 00000100:00100000:2.0:1790391382.545453:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186407552 00000100:00100000:2.0:1790391382.545464:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186407552 00000100:00100000:2.0:1790391382.545513:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186408064 00000100:00100000:2.0:1790391382.545517:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186408064 00000100:00100000:2.0:1790391382.545531:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186407296 00000100:00100000:2.0:1790391382.545533:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186407296 00000100:00100000:2.0:1790391382.545543:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186407680 00000100:00100000:2.0:1790391382.545546:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186407680 00000100:00100000:2.0:1790391382.545556:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186408192 00000100:00100000:2.0:1790391382.545559:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186408192 00000100:00100000:2.0:1790391382.545583:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790391382.545590:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186407040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391382.548728:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186407040:12345-0@lo:400:kworker.0 Request processed in 3132us (8958us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391382.548741:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790391382.548778:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790391382.548792:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186407552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391382.548826:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186407552:12345-0@lo:400:kworker.0 Request processed in 41us (9013us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391382.548831:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1790391382.548843:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790391382.548850:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186408064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391382.548903:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186408064:12345-0@lo:400:kworker.0 Request processed in 53us (9052us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391382.548909:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790391382.548920:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790391382.548927:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186407296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.549295:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186407936 00000100:00100000:1.0:1790391382.549316:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186407936 00000100:00100000:1.0:1790391382.549362:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186408448 00000100:00100000:1.0:1790391382.549367:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186408448 00000100:00100000:1.0:1790391382.549381:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186407808 00000100:00100000:1.0:1790391382.549384:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186407808 00000100:00100000:1.0:1790391382.549395:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186408320 00000100:00100000:1.0:1790391382.549398:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186408320 00000100:00100000:1.0:1790391382.549412:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790391382.549418:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186407936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391382.549666:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790391382.549675:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186408448:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790391382.553841:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391382.553852:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391382.553855:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391382.553858:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391382.554698:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790391382.554720:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186407808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391382.554821:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186407808:12345-0@lo:400:kworker.0 Request processed in 112us (14073us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391382.554830:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790391382.554855:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790391382.554863:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186408320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391382.554918:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186408320:12345-0@lo:400:kworker.0 Request processed in 56us (13553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391382.554925:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1790391382.555648:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5292339f80 x1877361186408320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391382.555666:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186408320:0@lo:400:kworker.0 00000100:00100000:0.0:1790391382.555716:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186407296:0@lo:400:kworker.0 00010000:00080000:0.0:1790391382.555729:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5284947b80 x1877361186407808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391382.555760:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186407808:0@lo:400:kworker.0 00000100:00100000:2.0:1790391382.559225:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186407296:12345-0@lo:400:kworker.0 Request processed in 10285us (18671us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391382.559250:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790391382.559290:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790391382.559424:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186407680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391382.559534:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186407680:12345-0@lo:400:kworker.0 Request processed in 236us (16453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391382.559541:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790391382.559553:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790391382.559559:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186408192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391382.559677:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186408192:12345-0@lo:400:kworker.0 Request processed in 117us (16563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391382.559683:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:2.0:1790391382.559758:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5284946300 x1877361186407680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391382.559773:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186407680:0@lo:400:kworker.0 00010000:00080000:2.0:1790391382.559784:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5284946d80 x1877361186408192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391382.559793:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186408192:0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.564280:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186407936:12345-0@lo:400:kworker.0 Request processed in 14851us (24988us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391382.564297:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790391382.564805:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186407040:0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.564822:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186407552:0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.564835:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186408064:0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.564860:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186406912:0@lo:400:kworker.0 00000100:00100000:1.0:1790391382.564873:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186407424:0@lo:400:kworker.0 00010000:00080000:1.0:1790391382.564907:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5284947480 x1877361186407936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391382.564918:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186407936:0@lo:400:kworker.0 00000100:00100000:2.0:1790391382.577280:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186408448:12345-0@lo:400:kworker.0 Request processed in 27598us (36810us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391382.577296:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1790391382.577724:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5292339180 x1877361186408448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391382.577740:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186408448:0@lo:400:kworker.0 00010000:00010000:3.0:1790391382.984075:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391383.048570:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391383.048595:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186408576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391383.048669:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391383.048744:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186408576 00000100:00100000:1.0:1790391383.048752:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186408576 00000100:00100000:1.0:1790391383.048803:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790391383.048813:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186408576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391383.048844:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391383.048916:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186408576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391383.048923:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1790391383.048963:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831df100 x1877361186408576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391383.048983:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186408576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391383.053551:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391383.053575:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186408704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391383.053643:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391383.053728:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186408704 00000100:00100000:2.0:1790391383.053736:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186408704 00000100:00100000:2.0:1790391383.053784:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790391383.053792:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186408704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790391383.053813:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391383.053853:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186408704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391383.053860:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1790391383.054024:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229f100 x1877361186408704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391383.054043:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186408704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391383.951175:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391383.951206:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391383.951231:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391383.951250:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391383.951271:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391383.951297:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169548928 00000100:00100000:0.0:1790391383.951309:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169548928 00000100:00100000:0.0:1790391383.951364:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169549184 00000100:00100000:0.0:1790391383.951367:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169549184 00000100:00100000:0.0:1790391383.951382:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169549056 00000100:00100000:0.0:1790391383.951384:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169549056 00000100:00100000:0.0:1790391383.951396:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169549312 00000100:00100000:0.0:1790391383.951398:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169549312 00000100:00100000:0.0:1790391383.951414:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 179 00000100:00100000:0.0:1790391383.951424:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169548928:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391383.953266:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 180 00000100:00100000:1.0:1790391383.953283:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169549184:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391383.954753:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169549184:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 1467us (3536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391383.954781:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 180 00000100:00100000:1.0:1790391383.954816:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 181 00000100:00100000:1.0:1790391383.954826:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169549056:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391383.954867:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169549056:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 43us (3615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391383.954873:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 181 00000100:00100000:1.0:1790391383.954904:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 182 00000100:00100000:1.0:1790391383.954911:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169549312:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391383.954937:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169549312:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 27us (3665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391383.954943:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 182 00000100:00100000:1.0:1790391383.954972:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169548800 00000100:00100000:1.0:1790391383.954980:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169548800 00000100:00100000:1.0:1790391383.955020:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 313 00000100:00100000:1.0:1790391383.955027:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169548800:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391383.955054:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169548800:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 27us (3822us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391383.955059:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 313 00000100:00080000:1.0:1790391383.955247:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391383.955254:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391383.963659:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169548928:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 12222us (12477us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391383.963674:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 179 00010000:00010000:0.0:1790391384.010289:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391384.072458:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391384.072496:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186408832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391384.072642:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391384.072716:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186408832 00000100:00100000:3.0:1790391384.072724:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186408832 00000100:00100000:3.0:1790391384.072794:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790391384.072804:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186408832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391384.072833:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391384.072899:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186408832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391384.072913:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1790391384.072936:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790391384.072991:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822a5880 x1877361186408832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391384.073010:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186408832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391384.073861:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391384.073873:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186408960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391384.073952:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391384.074169:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186408960 00000100:00100000:3.0:1790391384.074175:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186408960 00000100:00100000:3.0:1790391384.074214:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790391384.074222:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186408960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391384.074250:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790391384.074414:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186408960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 192us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391384.074421:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790391384.074454:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186408960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391384.078262:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391384.078291:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186409088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391384.078375:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391384.078827:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186409088 00000100:00100000:0.0:1790391384.078836:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186409088 00000100:00100000:0.0:1790391384.078916:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790391384.078939:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186409088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391384.078963:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1790391384.079187:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391384.079866:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186409088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 928us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391384.079898:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1790391384.080495:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229f100 x1877361186409088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391384.080520:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186409088:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1790391384.587280:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6b4e828e-5852-4c32-bc74-22a6cf01e473 00000020:00000080:0.0:1790391384.587291:0:9505:0:(genops.c:885:class_export_put()) final put ffff9e5183331800/6b4e828e-5852-4c32-bc74-22a6cf01e473 00000001:00100000:0.0:1790391384.588824:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6b4e828e-5852-4c32-bc74-22a6cf01e473 00000020:00000080:0.0:1790391384.588832:0:8421:0:(genops.c:885:class_export_put()) final put ffff9e5183330800/6b4e828e-5852-4c32-bc74-22a6cf01e473 00000020:00000080:3.0:1790391384.595977:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183331800/6b4e828e-5852-4c32-bc74-22a6cf01e473 for lustre-OST0001 00000020:00000080:3.0:1790391384.596055:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5183332000 for lustre-OST0001 00000020:00000080:3.0:1790391384.598148:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183330800/6b4e828e-5852-4c32-bc74-22a6cf01e473 for lustre-OST0000 00000020:00000080:3.0:1790391384.598202:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5183333800 for lustre-OST0000 00010000:00010000:3.0:1790391385.032097:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790391385.810068:0:13178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd73f68230 20000000:00000080:0.0:1790391385.810089:0:13178:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e51832d0c00 uarg=0000000000000000 20000000:01000000:0.0:1790391385.810137:0:13178:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790391385.810143:0:13178:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790391385.810149:0:13178:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790391385.811548:0:13179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1790391385.811708:0:13178:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790391385.824519:0:13178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790391385.824651:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824672:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e101a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e1013 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824696:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e1028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e1021 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824703:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e529566c800/0x2b1b7949f13e1036 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e102f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824709:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52c21f6a00/0x2b1b7949f13e1044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e103d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824720:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e104b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b002e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824727:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e1060 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b006d expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824733:0:13178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824769:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e1060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b006d expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824780:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e1060 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b006d expref: 12 pid: 6506 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391385.824792:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409216:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391385.824927:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e104b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b002e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824937:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e104b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b002e expref: 12 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391385.824954:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409344:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391385.824989:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52c21f6a00/0x2b1b7949f13e1044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e103d expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.824997:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52c21f6a00/0x2b1b7949f13e1044 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e103d expref: 23 pid: 6506 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391385.825007:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409472:0@lo:104: 00000100:00100000:3.0:1790391385.832485:0:13178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391385.832575:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e529566c800/0x2b1b7949f13e1036 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e102f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391385.832575:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00010000:00010000:3.0:1790391385.832591:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e529566c800/0x2b1b7949f13e1036 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e102f expref: 23 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391385.832607:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409600:0@lo:104: 00000100:00100000:3.0:1790391385.832648:0:13178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391385.832654:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00010000:00010000:3.0:1790391385.832670:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e1028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e1021 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.832679:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e1028 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e1021 expref: 23 pid: 6507 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391385.832687:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409728:0@lo:104: 00000100:00100000:1.0:1790391385.832687:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169549440 00000100:00100000:1.0:1790391385.832693:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169549440 00000100:00100000:3.0:1790391385.832706:0:13178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391385.832721:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e101a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e1013 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391385.832722:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e1060 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b006d expref: 13 pid: 6506 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.832747:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e101a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e1013 expref: 23 pid: 6506 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391385.832749:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169549568 00000100:00100000:1.0:1790391385.832752:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169549568 00000100:00100000:3.0:1790391385.832756:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409856:0@lo:104: 00010000:00010000:1.0:1790391385.832763:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e104b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b002e expref: 14 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391385.832779:0:13178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391385.832786:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:3.0:1790391385.832789:0:13178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391385.832795:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+14:2384:x1877361169549440:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391385.832808:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790391385.832811:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409216:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391385.832813:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e1060 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b006d expref: 14 pid: 6506 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391385.832819:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409344:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391385.832825:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e1060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b006d expref: 14 pid: 6506 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391385.832841:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f6600/0x2b1b7949f13e1060 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b006d expref: 14 pid: 6506 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391385.832854:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 41 00010000:00010000:1.0:1790391385.832856:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391385.832860:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169549568:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391385.832868:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391385.832873:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e104b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b002e expref: 13 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391385.832914:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169549440:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 119us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391385.832922:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186409472 00000100:00100000:1.0:1790391385.832922:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:2.0:1790391385.832926:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186409472 00000100:00100000:2.0:1790391385.832946:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186409600 00000100:00100000:2.0:1790391385.832949:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186409600 00000100:00100000:2.0:1790391385.832958:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186409728 00000100:00100000:2.0:1790391385.832960:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186409728 00000100:00100000:2.0:1790391385.832968:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186409856 00000100:00100000:2.0:1790391385.832970:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186409856 00000100:00100000:2.0:1790391385.832979:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790391385.832985:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+6:13178:x1877361186409472:12345-0@lo:104: 00010000:00010000:2.0:1790391385.832997:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833063:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391385.833069:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+6:13178:x1877361186409472:12345-0@lo:104: Request processed in 84us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391385.833076:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790391385.833090:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790391385.833096:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:13178:x1877361186409600:12345-0@lo:104: 00010000:00010000:2.0:1790391385.833103:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833137:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391385.833141:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:13178:x1877361186409600:12345-0@lo:104: Request processed in 46us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391385.833147:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790391385.833159:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790391385.833164:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:13178:x1877361186409728:12345-0@lo:104: 00010000:00010000:2.0:1790391385.833171:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833197:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790391385.833202:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:13178:x1877361186409728:12345-0@lo:104: Request processed in 39us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391385.833208:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790391385.833219:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391385.833224:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:13178:x1877361186409856:12345-0@lo:104: 00010000:00010000:2.0:1790391385.833231:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833263:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790391385.833268:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:13178:x1877361186409856:12345-0@lo:104: Request processed in 44us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391385.833273:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1790391385.833289:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790391385.833295:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833302:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566de00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391385.833306:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833315:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391385.833322:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391385.833328:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790391385.833353:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833359:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391385.833376:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833382:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566de00/0x2b1b7949f13e103d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e1044 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833404:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790391385.833407:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833412:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566da00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391385.833415:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833423:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391385.833429:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391385.833434:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790391385.833458:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833465:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391385.833472:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833478:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566da00/0x2b1b7949f13e102f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e1036 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833486:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391385.833489:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833505:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566ce00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391385.833509:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833516:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391385.833521:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391385.833526:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790391385.833542:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833546:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391385.833562:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833567:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566ce00/0x2b1b7949f13e1021 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e1028 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833577:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391385.833580:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833585:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566ca00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391385.833587:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833604:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391385.833610:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391385.833615:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790391385.833630:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833636:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391385.833642:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833649:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566ca00/0x2b1b7949f13e1013 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e101a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.833661:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391385.833663:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391385.833664:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391385.833676:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186409984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391385.833705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391385.833727:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391385.833732:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186410112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391385.833751:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391385.833772:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186410240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391385.833793:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391385.833806:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391385.833820:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186410368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391385.833843:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391385.833862:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186409984 00000100:00100000:2.0:1790391385.833866:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186409984 00010000:00010000:2.0:1790391385.833903:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52c21f6a00/0x2b1b7949f13e1044 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e103d expref: 24 pid: 6506 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391385.833918:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186410112 00000100:00100000:2.0:1790391385.833922:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186410112 00010000:00010000:2.0:1790391385.833933:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e529566c800/0x2b1b7949f13e1036 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e102f expref: 25 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391385.833944:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186410240 00000100:00100000:2.0:1790391385.833946:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186410240 00010000:00010000:2.0:1790391385.833955:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e1028 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e1021 expref: 26 pid: 6507 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391385.833964:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186410368 00000100:00100000:2.0:1790391385.833966:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186410368 00010000:00010000:2.0:1790391385.833975:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e101a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e1013 expref: 27 pid: 6506 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391385.833985:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391385.833989:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+27:3637:x1877361186409984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391385.833996:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391385.834000:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52c21f6a00/0x2b1b7949f13e1044 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e103d expref: 27 pid: 6506 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.834007:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52c21f6a00/0x2b1b7949f13e1044 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e103d expref: 27 pid: 6506 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.834028:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391385.834056:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+27:3637:x1877361186409984:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391385.834062:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391385.834075:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391385.834081:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+26:3637:x1877361186410112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391385.834088:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391385.834092:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e529566c800/0x2b1b7949f13e1036 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e102f expref: 26 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.834098:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e529566c800/0x2b1b7949f13e1036 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e102f expref: 26 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.834106:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391385.834125:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+26:3637:x1877361186410112:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391385.834131:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391385.834142:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391385.834148:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+25:3639:x1877361186410240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391385.834154:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391385.834158:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e1028 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e1021 expref: 25 pid: 6507 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.834164:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e1028 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e1021 expref: 25 pid: 6507 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.834172:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391385.834202:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+25:3639:x1877361186410240:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391385.834208:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391385.834220:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391385.834224:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186410368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391385.834231:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391385.834235:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e101a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e1013 expref: 24 pid: 6506 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.834243:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e101a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e1013 expref: 24 pid: 6506 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.834251:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391385.834271:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186410368:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391385.834277:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391385.834303:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186410368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391385.834310:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186410240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391385.834332:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186410112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391385.834338:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186409984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391385.834582:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391385.835011:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f6a00/0x2b1b7949f13e1044 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e103d expref: 23 pid: 6506 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391385.835051:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409472:0@lo:104: 00010000:00010000:1.0:1790391385.835066:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566c800/0x2b1b7949f13e1036 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e102f expref: 22 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391385.835074:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409600:0@lo:104: 00010000:00010000:1.0:1790391385.835083:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566c400/0x2b1b7949f13e1028 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e1021 expref: 21 pid: 6507 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391385.835090:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409728:0@lo:104: 00010000:00010000:1.0:1790391385.835097:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031400/0x2b1b7949f13e101a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e1013 expref: 20 pid: 6506 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391385.835105:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1877361186409856:0@lo:104: 00010000:00010000:1.0:1790391385.835130:0:13178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837089:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e104b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b002e expref: 12 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837108:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eee600/0x2b1b7949f13e104b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b002e expref: 12 pid: 6505 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837125:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837134:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837156:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837174:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837180:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837186:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837192:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391385.837196:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837204:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837225:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391385.837236:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391385.837304:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:2384:x1877361169549568:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 4442us (4647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391385.837314:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 41 00010000:00010000:2.0:1790391385.838115:0:13178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.838126:0:13178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391385.838133:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e1083 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391386.058071:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391386.121816:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186410496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391386.121939:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391386.122053:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186410496 00000100:00100000:0.0:1790391386.122062:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186410496 00000100:00100000:0.0:1790391386.122120:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790391386.122130:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186410496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790391386.122176:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790391386.126638:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186410496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4501us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391386.126651:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790391386.126813:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186410496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391386.894021:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391386.894182:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169549696 00000100:00100000:3.0:1790391386.894192:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169549696 00000100:00100000:3.0:1790391386.894249:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 314 00000100:00100000:3.0:1790391386.894259:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:6159:x1877361169549696:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391386.894302:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391386.894324:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e108a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b009e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391386.894353:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e108a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b009e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391386.894366:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e108a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b009e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391386.894375:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280030e00, rc 0) 00000100:00100000:3.0:1790391386.894431:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169549696:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 Request processed in 174us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391386.894449:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 314 00000100:00100000:3.0:1790391386.897315:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391386.897414:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169549824 00000100:00100000:2.0:1790391386.897425:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169549824 00000100:00100000:2.0:1790391386.897543:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 315 00000100:00100000:2.0:1790391386.897553:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169549824:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391386.897711:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169549824:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 Request processed in 159us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391386.897719:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 315 00000100:00100000:3.0:1790391386.906534:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391386.907146:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169549952 00000100:00100000:2.0:1790391386.907157:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169549952 00000100:00100000:2.0:1790391386.907212:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 316 00000100:00100000:2.0:1790391386.907222:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169549952:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391386.907391:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169549952:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 Request processed in 170us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391386.907399:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 316 00000100:00100000:3.0:1790391386.931561:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391386.931651:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169550080 00000100:00100000:1.0:1790391386.931662:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169550080 00000100:00100000:1.0:1790391386.931720:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 317 00000100:00100000:1.0:1790391386.931731:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169550080:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391386.931758:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391386.931779:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e1091 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00a5 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391386.931809:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e1091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00a5 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391386.931833:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e1091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00a5 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391386.931843:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087000, rc 0) 00000100:00100000:1.0:1790391386.931938:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:6159:x1877361169550080:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 Request processed in 208us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391386.931946:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 317 00000100:00100000:3.0:1790391386.935645:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391386.935709:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169550208 00000100:00100000:0.0:1790391386.935721:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169550208 00000100:00100000:0.0:1790391386.935777:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 318 00000100:00100000:0.0:1790391386.935787:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:6159:x1877361169550208:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391386.935982:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:6159:x1877361169550208:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 Request processed in 196us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391386.935991:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 318 00000100:00100000:3.0:1790391386.940246:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391386.940673:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169550336 00000100:00100000:0.0:1790391386.940688:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169550336 00000100:00100000:0.0:1790391386.942425:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 319 00000100:00100000:0.0:1790391386.942459:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:6159:x1877361169550336:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391386.946582:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:6159:x1877361169550336:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 Request processed in 4055us (6259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391386.946603:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 319 00010000:00010000:1.0:1790391387.080642:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790391387.272451:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391387.272459:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52bf9b4000 from 7 10000000:01000000:0.0:1790391387.272464:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391387.272509:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.272522:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.272533:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391387.272557:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186410624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391387.272617:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.272666:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330d900 going to sleep for 11 seconds 00000100:00100000:3.0:1790391387.272716:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186410624 00000100:00100000:3.0:1790391387.272722:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186410624 00000100:00100000:3.0:1790391387.272780:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1790391387.272789:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186410624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391387.272802:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391387.272812:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e109f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e1098 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.272834:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e109f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e1098 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.272851:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e109f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e1098 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.272860:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031a00, rc 0) 00000100:00100000:3.0:1790391387.272962:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186410624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391387.272968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1790391387.273012:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186410624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391387.273037:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.273046:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391387.273103:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186410752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391387.273127:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391387.273139:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391387.273385:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186410752 00000100:00100000:0.0:1790391387.273390:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186410752 00000100:00100000:0.0:1790391387.273423:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1790391387.273446:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186410752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391387.273556:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186410752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.273562:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1790391387.275158:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186410752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391387.275224:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186410880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391387.275283:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391387.275325:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391387.275593:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186410880 00000100:00100000:0.0:1790391387.275600:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186410880 00000100:00100000:0.0:1790391387.275654:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1790391387.275664:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186410880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391387.275779:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186410880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.275786:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1790391387.276925:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186410880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790391387.282491:0:13229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790391387.283119:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790391387.283146:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391387.283157:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.283169:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391387.283180:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391387.283183:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b77e2800 from 7 10000000:01000000:0.0:1790391387.283185:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391387.283225:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.283233:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.283244:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391387.283278:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391387.283350:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.283388:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330d780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391387.284495:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186411008 00000100:00100000:3.0:1790391387.284512:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186411008 00000100:00100000:3.0:1790391387.284571:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1790391387.284581:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186411008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391387.284596:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391387.284613:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280030400/0x2b1b7949f13e10ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e10a6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.284638:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280030400/0x2b1b7949f13e10ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e10a6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.284651:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280030400/0x2b1b7949f13e10ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e10a6 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.284660:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280030400, rc 0) 00000100:00100000:3.0:1790391387.284737:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186411008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391387.284745:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1790391387.284986:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391387.285002:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.285011:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391387.285202:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391387.285235:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391387.285270:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820db40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391387.285596:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186411136 00000100:00100000:3.0:1790391387.285602:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186411136 00000100:00100000:3.0:1790391387.285637:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1790391387.285644:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5289dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186411136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391387.286956:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5289dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186411136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1306us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391387.286967:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1790391387.310972:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391387.311204:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391387.311280:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391387.311319:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391387.311856:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186411264 00000100:00100000:0.0:1790391387.311863:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186411264 00000100:00100000:0.0:1790391387.311942:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1790391387.311952:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186411264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391387.312080:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186411264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.312088:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1790391387.312485:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790391387.313744:0:13230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790391387.320950:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790391387.320986:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391387.320999:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.321011:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391387.321034:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391387.321036:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b5eaa800 from 7 10000000:01000000:0.0:1790391387.321040:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391387.321087:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.321096:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.321115:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391387.321147:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391387.321218:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.321261:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330d780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391387.321387:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186411392 00000100:00100000:1.0:1790391387.321394:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186411392 00000100:00100000:1.0:1790391387.321454:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1790391387.321464:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186411392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391387.321477:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391387.321490:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5183086e00/0x2b1b7949f13e10bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e10b4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.321528:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183086e00/0x2b1b7949f13e10bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e10b4 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.321539:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5183086e00/0x2b1b7949f13e10bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e10b4 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.321548:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086e00, rc 0) 00000100:00100000:1.0:1790391387.321590:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186411392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391387.321597:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1790391387.322132:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391387.322148:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.322157:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391387.322219:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391387.322249:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.322272:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330d780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391387.322325:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186411520 00000100:00100000:1.0:1790391387.322330:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186411520 00000100:00100000:1.0:1790391387.322363:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1790391387.322370:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186411520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391387.322487:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186411520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391387.322495:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1790391387.322860:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391387.322923:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391387.322964:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.322982:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528330d780 going to sleep for 11 seconds 00000100:00100000:1.0:1790391387.323053:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186411648 00000100:00100000:1.0:1790391387.323058:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186411648 00000100:00100000:1.0:1790391387.323085:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1790391387.323092:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186411648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391387.323163:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186411648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391387.323170:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1790391387.323298:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790391387.324237:0:13231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790391387.324857:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790391387.324918:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391387.324935:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.324945:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391387.324956:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790391387.324959:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5289da8000 from 7 10000000:01000000:1.0:1790391387.324961:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391387.324994:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.325002:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391387.325071:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391387.325096:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391387.325152:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391387.325188:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391387.325411:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186411776 00000100:00100000:0.0:1790391387.325419:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186411776 00000100:00100000:0.0:1790391387.325472:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1790391387.325481:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186411776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391387.325491:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391387.325504:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e10c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e10c2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.325528:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e10c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e10c2 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.325539:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e10c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e10c2 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.325548:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef200, rc 0) 00000100:00100000:0.0:1790391387.325595:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186411776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.325602:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1790391387.325716:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391387.325729:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391387.325738:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391387.325912:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391387.325942:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391387.326009:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391387.330106:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186411904 00000100:00100000:1.0:1790391387.330124:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186411904 00000100:00100000:0.0:1790391387.330995:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1790391387.331009:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186411904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391387.331207:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186411904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (5262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.331215:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1790391387.333177:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186411904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391387.333237:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186412032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391387.333302:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391387.333402:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391387.336104:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186412032 00000100:00100000:1.0:1790391387.336119:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186412032 00000100:00100000:1.0:1790391387.336213:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1790391387.336223:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186412032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391387.336377:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186412032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (3074us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391387.336385:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1790391387.336480:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186412032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790391387.348819:0:13232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790391387.349137:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790391387.349161:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391387.349172:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391387.349184:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391387.661351:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186412544:0@lo:400:kworker.0 00000100:00100000:2.0:1790391387.661446:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391387.661505:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186413056:0@lo:400:kworker.0 00000100:00100000:2.0:1790391387.661539:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391387.661570:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186413568:0@lo:400:kworker.0 00000100:00100000:2.0:1790391387.661609:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391387.661634:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1790391387.661641:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186412160:0@lo:400:kworker.0 00000100:00100000:2.0:1790391387.661671:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391387.661696:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186412672:0@lo:400:kworker.0 00000100:00100000:2.0:1790391387.661721:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391387.661740:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186413184:0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.662115:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186413056 00000100:00100000:0.0:1790391387.662124:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186413056 00000100:00100000:0.0:1790391387.662176:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186413568 00000100:00100000:0.0:1790391387.662180:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186413568 00000100:00100000:0.0:1790391387.662206:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790391387.662215:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186413056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391387.662532:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186412544 00000100:00100000:3.0:1790391387.662538:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186412544 00000100:00100000:3.0:1790391387.662577:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1790391387.662584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186412544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391387.662900:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790391387.662911:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186413568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.665569:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186413056:12345-0@lo:400:kworker.0 Request processed in 3344us (4019us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.665586:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1790391387.665655:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391387.665662:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391387.665706:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186412288:0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.665774:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.665805:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186412800:0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.665829:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.665847:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186413312:0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.665865:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.665902:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790391387.665919:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186412416:0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.669563:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.669635:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186412928:0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.669674:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.669688:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186413440:0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.669708:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391387.669781:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186412288 00000100:00100000:0.0:1790391387.669790:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186412288 00000100:00100000:0.0:1790391387.670091:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186412800 00000100:00100000:0.0:1790391387.670096:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186412800 00000100:00100000:0.0:1790391387.670131:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186413312 00000100:00100000:0.0:1790391387.670135:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186413312 00000100:00100000:0.0:1790391387.670148:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186412928 00000100:00100000:0.0:1790391387.670151:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186412928 00000100:00100000:0.0:1790391387.670161:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186413440 00000100:00100000:0.0:1790391387.670163:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186413440 00000100:00100000:0.0:1790391387.670179:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1790391387.670187:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186412288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.670249:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186412288:12345-0@lo:400:kworker.0 Request processed in 62us (4475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.670257:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1790391387.670273:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790391387.670279:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186412800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.670309:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186412800:12345-0@lo:400:kworker.0 Request processed in 31us (4480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.670316:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790391387.670327:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790391387.670332:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186413312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.670358:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186413312:12345-0@lo:400:kworker.0 Request processed in 25us (4491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.670365:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790391387.671199:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790391387.671215:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186412928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.671283:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186412928:12345-0@lo:400:kworker.0 Request processed in 74us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.671362:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790391387.671378:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790391387.671384:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186413440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.671412:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186413440:12345-0@lo:400:kworker.0 Request processed in 29us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.671417:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790391387.675301:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186412672 00000100:00100000:0.0:1790391387.675315:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186412672 00000100:00100000:0.0:1790391387.675375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186412416 00000100:00100000:0.0:1790391387.675379:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186412416 00000100:00100000:0.0:1790391387.675399:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790391387.675409:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186412672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.675515:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186412672:12345-0@lo:400:kworker.0 Request processed in 107us (13792us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.675523:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790391387.675542:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790391387.675548:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186412416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.675579:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186412416:12345-0@lo:400:kworker.0 Request processed in 32us (6024us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.675585:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1790391387.675600:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391387.675604:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391387.675635:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186412416:0@lo:400:kworker.0 00010000:00080000:0.0:1790391387.675658:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51832cf800 x1877361186412928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391387.675669:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186412928:0@lo:400:kworker.0 00010000:00080000:0.0:1790391387.675698:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229f100 x1877361186413440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391387.675706:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186413440:0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.675717:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186412288:0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.675729:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186412800:0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.675739:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186413312:0@lo:400:kworker.0 00000100:00100000:3.0:1790391387.680154:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186412544:12345-0@lo:400:kworker.0 Request processed in 17558us (18696us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391387.680171:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1790391387.680946:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186412160 00000100:00100000:0.0:1790391387.680956:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186412160 00000100:00100000:0.0:1790391387.681005:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1790391387.681015:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186412160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391387.681093:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186412160:12345-0@lo:400:kworker.0 Request processed in 80us (19421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391387.681100:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1790391387.681550:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186413568:12345-0@lo:400:kworker.0 Request processed in 18639us (19936us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391387.681561:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790391387.683016:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391387.683146:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186413184 00000100:00100000:3.0:1790391387.683155:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186413184 00000100:00100000:3.0:1790391387.683217:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790391387.683234:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186413184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391387.683562:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186413184:12345-0@lo:400:kworker.0 Request processed in 330us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391387.683570:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1790391387.684409:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790391387.684793:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52849ba300 x1877361186413184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391387.684810:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186413184:0@lo:400:kworker.0 00000100:00100000:1.0:1790391387.684820:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186413696:0@lo:400:kworker.0 00000100:00100000:1.0:1790391387.684865:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391387.684962:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186412544:0@lo:400:kworker.0 00010000:00080000:1.0:1790391387.684975:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51832cc700 x1877361186413056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391387.684984:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186413056:0@lo:400:kworker.0 00010000:00080000:1.0:1790391387.684997:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183817b80 x1877361186413568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391387.685009:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186413568:0@lo:400:kworker.0 00000100:00100000:1.0:1790391387.685187:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186412160:0@lo:400:kworker.0 00000100:00100000:1.0:1790391387.685475:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186412672:0@lo:400:kworker.0 00000100:00100000:3.0:1790391387.686141:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186413696 00000100:00100000:3.0:1790391387.686150:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186413696 00000100:00100000:3.0:1790391387.686214:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790391387.686225:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186413696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391387.686295:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186413696:12345-0@lo:400:kworker.0 Request processed in 72us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391387.686302:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1790391387.686338:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183816680 x1877361186413696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391387.686350:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186413696:0@lo:400:kworker.0 00000100:00080000:1.0:1790391387.686398:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790391388.104501:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391388.169350:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186413824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391388.169573:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391388.171993:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186413824 00000100:00100000:2.0:1790391388.172019:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186413824 00000100:00100000:2.0:1790391388.172084:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790391388.172096:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186413824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391388.172131:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391388.174193:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186413952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391388.174260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391388.174326:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186413952 00000100:00100000:3.0:1790391388.174333:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186413952 00000100:00100000:3.0:1790391388.174379:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790391388.174387:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186413952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790391388.174409:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391388.176448:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186413952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2038us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391388.176462:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1790391388.176533:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518206df80 x1877361186413952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391388.176574:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186413952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391388.176818:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186413824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4722us (7243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391388.176827:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1790391388.178708:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b7792300 x1877361186413824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391388.178734:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186413824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391389.068982:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391389.069017:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391389.069033:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391389.069046:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391389.069063:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391389.069092:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169550464 00000100:00100000:2.0:1790391389.069101:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169550464 00000100:00100000:2.0:1790391389.069145:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 333 00000100:00100000:2.0:1790391389.069154:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2381:x1877361169550464:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391389.069216:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2381:x1877361169550464:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 63us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391389.069233:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 333 00000100:00100000:2.0:1790391389.069264:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169550720 00000100:00100000:2.0:1790391389.069268:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169550720 00000100:00100000:2.0:1790391389.069292:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169550976 00000100:00100000:2.0:1790391389.069294:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169550976 00000100:00100000:2.0:1790391389.069304:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169550592 00000100:00100000:2.0:1790391389.069306:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169550592 00000100:00100000:2.0:1790391389.069315:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169550848 00000100:00100000:2.0:1790391389.069317:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169550848 00000100:00100000:2.0:1790391389.069328:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 189 00000100:00100000:2.0:1790391389.069334:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169550720:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391389.069363:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169550720:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391389.069369:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 189 00000100:00100000:2.0:1790391389.069379:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 190 00000100:00100000:2.0:1790391389.069384:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169550976:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391389.069400:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169550976:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 16us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391389.069406:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 190 00000100:00100000:2.0:1790391389.069413:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 191 00000100:00100000:2.0:1790391389.069430:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2381:x1877361169550592:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391389.069450:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2381:x1877361169550592:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 32us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391389.069455:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 191 00000100:00100000:2.0:1790391389.069465:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 192 00000100:00100000:2.0:1790391389.069476:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169550848:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391389.069496:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169550848:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 22us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391389.069502:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 192 00000100:00080000:2.0:1790391389.071809:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391389.071816:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1790391389.136163:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391389.192168:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186414080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391389.192269:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391389.192347:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391389.192355:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186414208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391389.192382:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391389.192437:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186414208 00000100:00100000:3.0:1790391389.192447:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186414208 00000100:00100000:3.0:1790391389.192520:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790391389.192531:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186414208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391389.192569:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391389.192623:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186414208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391389.192633:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1790391389.192662:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790391389.192705:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518206e680 x1877361186414208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391389.192727:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186414208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391389.195915:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186414080 00000100:00100000:0.0:1790391389.195929:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186414080 00000100:00100000:0.0:1790391389.196003:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790391389.196015:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186414080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391389.196059:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391389.196163:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186414080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (3894us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391389.196171:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790391389.196273:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186414336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391389.196324:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391389.196447:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186414080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391389.196527:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186414336 00000100:00100000:0.0:1790391389.196543:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186414336 00000100:00100000:0.0:1790391389.196591:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790391389.196598:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186414336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391389.196615:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391389.196652:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186414336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391389.196659:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1790391389.196721:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790391389.196746:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5284945c00 x1877361186414336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391389.196778:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186414336:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1790391389.562408:0:13377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790391390.155987:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391391.183485:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391391.246416:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186414464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391391.246521:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391391.246658:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186414464 00000100:00100000:1.0:1790391391.246669:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186414464 00000100:00100000:1.0:1790391391.246735:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790391391.246746:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186414464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391391.246791:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790391391.246855:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186414464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391391.246863:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790391391.246951:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186414464:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790391392.206065:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391392.777600:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186414592:0@lo:400:kworker.0 00000100:00100000:3.0:1790391392.777692:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391392.777806:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186414592 00000100:00100000:0.0:1790391392.777825:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186414592 00000100:00100000:0.0:1790391392.777961:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1790391392.777975:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186414592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391392.782963:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186414720:0@lo:400:kworker.0 00000100:00100000:1.0:1790391392.783073:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391392.783171:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186414720 00000100:00100000:1.0:1790391392.783181:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186414720 00000100:00100000:1.0:1790391392.783247:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1790391392.783258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186414720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391392.783325:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186414720:12345-0@lo:400:kworker.0 Request processed in 68us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391392.783333:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1790391392.783405:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186414720:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.786749:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186414592:12345-0@lo:400:kworker.0 Request processed in 8760us (9039us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391392.786770:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1790391392.788286:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186415232:0@lo:400:kworker.0 00000100:00100000:2.0:1790391392.788361:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391392.788410:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186415744:0@lo:400:kworker.0 00000100:00100000:2.0:1790391392.788435:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391392.788459:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790391392.788465:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186415104:0@lo:400:kworker.0 00000100:00100000:2.0:1790391392.788492:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391392.788509:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186415616:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.788759:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186414848:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.788791:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391392.788815:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186415360:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.788837:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391392.788853:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186415872:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.788897:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391392.788918:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790391392.788924:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186414976:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.788946:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391392.788972:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186415488:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.788996:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391392.789013:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186416000:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.789030:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391392.789064:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186415232 00000100:00100000:0.0:1790391392.789072:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186415232 00000100:00100000:0.0:1790391392.789132:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186415744 00000100:00100000:0.0:1790391392.789135:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186415744 00000100:00100000:0.0:1790391392.789147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186415360 00000100:00100000:0.0:1790391392.789149:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186415360 00000100:00100000:0.0:1790391392.789160:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186415872 00000100:00100000:0.0:1790391392.789162:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186415872 00000100:00100000:0.0:1790391392.789173:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186414976 00000100:00100000:0.0:1790391392.789175:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186414976 00000100:00100000:0.0:1790391392.789189:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1790391392.789196:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186415232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.789244:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186415232:12345-0@lo:400:kworker.0 Request processed in 48us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391392.789251:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1790391392.789278:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790391392.789284:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186415744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.789309:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186415744:12345-0@lo:400:kworker.0 Request processed in 26us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391392.789315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790391392.789325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790391392.789331:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186415360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.789360:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186415360:12345-0@lo:400:kworker.0 Request processed in 29us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391392.789377:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1790391392.789403:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790391392.789409:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186415872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.789440:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186415872:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391392.789445:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790391392.789457:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790391392.789463:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186414976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.789488:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186414976:12345-0@lo:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391392.789494:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790391392.789693:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186415104 00000100:00100000:0.0:1790391392.789697:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186415104 00000100:00100000:0.0:1790391392.789728:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186414848 00000100:00100000:0.0:1790391392.789732:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186414848 00000100:00100000:0.0:1790391392.789744:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790391392.789750:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186415104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.789786:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186415104:12345-0@lo:400:kworker.0 Request processed in 36us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391392.789792:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790391392.789804:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790391392.789810:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186414848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.789837:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186414848:12345-0@lo:400:kworker.0 Request processed in 27us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391392.789842:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1790391392.789871:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391392.789896:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391392.789935:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186414976:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.789946:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186414848:0@lo:400:kworker.0 00010000:00080000:0.0:1790391392.789957:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820afb80 x1877361186415360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391392.789967:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186415360:0@lo:400:kworker.0 00010000:00080000:0.0:1790391392.789975:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820aed80 x1877361186415872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391392.789983:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186415872:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.790062:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186415488 00000100:00100000:0.0:1790391392.790067:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186415488 00000100:00100000:2.0:1790391392.790397:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391392.790427:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186416128:0@lo:400:kworker.0 00000100:00100000:2.0:1790391392.790451:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391392.790479:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186415232:0@lo:400:kworker.0 00000100:00100000:2.0:1790391392.790488:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186415744:0@lo:400:kworker.0 00000100:00100000:2.0:1790391392.790508:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186415104:0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.790609:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186416000 00000100:00100000:0.0:1790391392.790613:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186416000 00000100:00100000:0.0:1790391392.790626:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186415616 00000100:00100000:0.0:1790391392.790628:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186415616 00000100:00100000:0.0:1790391392.790640:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186416128 00000100:00100000:0.0:1790391392.790643:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186416128 00000100:00100000:0.0:1790391392.790657:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790391392.790664:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186415488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391392.790690:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790391392.790704:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186416000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391392.790712:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186415488:12345-0@lo:400:kworker.0 Request processed in 47us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391392.790720:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790391392.790735:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790391392.790744:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186415616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391392.790753:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186416000:12345-0@lo:400:kworker.0 Request processed in 53us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391392.790761:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790391392.790782:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9f42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186415616:12345-0@lo:400:kworker.0 Request processed in 40us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391392.790796:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790391392.790805:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186416128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391392.790836:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186416128:12345-0@lo:400:kworker.0 Request processed in 33us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391392.790911:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186414592:0@lo:400:kworker.0 00000100:00080000:3.0:1790391392.790963:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391392.790967:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790391392.790986:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820af480 x1877361186415616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391392.790997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186415616:0@lo:400:kworker.0 00010000:00080000:2.0:1790391392.791019:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820ac000 x1877361186416128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391392.791038:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186416128:0@lo:400:kworker.0 00010000:00080000:2.0:1790391392.791250:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820aca80 x1877361186415488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391392.791417:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790391392.791585:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186415488:0@lo:400:kworker.0 00010000:00080000:2.0:1790391392.791606:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51820ae300 x1877361186416000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391392.791616:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186416000:0@lo:400:kworker.0 00000100:00100000:1.0:1790391392.791925:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:1.0:1790391393.224201:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391393.288231:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186416256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391393.288327:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391393.288619:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186416256 00000100:00100000:2.0:1790391393.288628:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186416256 00000100:00100000:2.0:1790391393.288679:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790391393.288689:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186416256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391393.288719:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391393.288777:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186416256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391393.288784:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1790391393.289932:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382e680 x1877361186416256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391393.289956:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186416256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391393.291311:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391393.291333:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186416384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391393.291512:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391393.291732:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186416384 00000100:00100000:2.0:1790391393.291742:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186416384 00000100:00100000:2.0:1790391393.291791:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790391393.291800:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186416384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790391393.291823:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391393.291866:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186416384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391393.291908:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1790391393.307868:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382c380 x1877361186416384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391393.308644:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186416384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391394.193565:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391394.193619:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391394.193655:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391394.193675:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391394.193701:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391394.193727:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169551232 00000100:00100000:0.0:1790391394.193736:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169551232 00000100:00100000:0.0:1790391394.193787:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169551360 00000100:00100000:0.0:1790391394.193790:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169551360 00000100:00100000:0.0:1790391394.193802:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169551616 00000100:00100000:0.0:1790391394.193805:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169551616 00000100:00100000:0.0:1790391394.193816:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169551488 00000100:00100000:0.0:1790391394.193818:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169551488 00000100:00100000:0.0:1790391394.193833:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 199 00000100:00100000:0.0:1790391394.193843:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169551232:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391394.193946:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 200 00000100:00100000:0.0:1790391394.193953:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169551232:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 109us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391394.193962:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169551360:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391394.193966:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 199 00000100:00100000:0.0:1790391394.193991:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 201 00000100:00100000:0.0:1790391394.194004:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2382:x1877361169551616:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391394.194022:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169551360:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391394.194032:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 200 00000100:00100000:0.0:1790391394.194037:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2382:x1877361169551616:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 37us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391394.194045:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 201 00000100:00100000:3.0:1790391394.194055:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 202 00000100:00100000:3.0:1790391394.194065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169551488:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391394.194095:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169551488:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391394.194102:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 202 00000100:00080000:3.0:1790391394.194124:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391394.194130:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391394.194264:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169551104 00000100:00100000:1.0:1790391394.194269:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169551104 00000100:00100000:1.0:1790391394.194325:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 335 00000100:00100000:1.0:1790391394.194332:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2382:x1877361169551104:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391394.194385:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2382:x1877361169551104:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 54us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391394.194392:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 335 00010000:00010000:2.0:1790391394.249757:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391394.314581:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391394.314607:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186416512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391394.314685:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391394.314760:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186416640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391394.314789:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391394.317644:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186416640 00000100:00100000:2.0:1790391394.317658:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186416640 00000100:00100000:2.0:1790391394.317728:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790391394.317738:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186416640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391394.317771:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391394.317849:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186416640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391394.317855:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1790391394.317906:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790391394.317960:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b5d05880 x1877361186416640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391394.317981:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186416640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391394.319091:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186416768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391394.319157:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391394.319223:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186416768 00000100:00100000:1.0:1790391394.319229:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186416768 00000100:00100000:1.0:1790391394.319267:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790391394.319276:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186416768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391394.319291:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391394.319326:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186416768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391394.319332:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1790391394.319364:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831ddf80 x1877361186416768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391394.319395:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186416768:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790391394.319586:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391394.319675:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186416512 00000100:00100000:0.0:1790391394.319681:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186416512 00000100:00100000:0.0:1790391394.319718:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790391394.319734:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186416512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391394.319760:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391394.319815:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186416512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (5130us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391394.319821:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790391394.319917:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186416512:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790391395.272227:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790391396.237520:0:13526:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:56:35 (1790391395) === 00010000:00010000:3.0:1790391396.298550:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391396.361918:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186416896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391396.361991:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391396.362104:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186416896 00000100:00100000:0.0:1790391396.362113:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186416896 00000100:00100000:0.0:1790391396.362173:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790391396.362182:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186416896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790391396.362215:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790391396.362280:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186416896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391396.362288:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790391396.362470:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186416896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391396.469182:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391396.469225:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391396.469266:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169551872 00000100:00100000:1.0:1790391396.469276:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169551872 00000100:00100000:1.0:1790391396.469331:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:1.0:1790391396.469342:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:10480:x1877361169551872:12345-192.168.202.28@tcp:700:mkdir.0 00000100:00100000:1.0:1790391396.469462:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:10480:x1877361169551872:12345-192.168.202.28@tcp:700:mkdir.0 Request processed in 121us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391396.469471:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00080000:1.0:1790391396.469494:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391396.470801:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169551744 00000100:00100000:3.0:1790391396.470813:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169551744 00000100:00100000:3.0:1790391396.473479:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:3.0:1790391396.473499:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2381:x1877361169551744:12345-192.168.202.28@tcp:41:mkdir.0 00000004:00000024:3.0:1790391396.473533:0:10091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790391396.473637:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2381:x1877361169551744:12345-192.168.202.28@tcp:41:mkdir.0 Request processed in 145us (4464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391396.473646:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:3.0:1790391396.473711:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.473823:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169552128 00000100:00100000:3.0:1790391396.473831:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169552128 00000100:00100000:3.0:1790391396.473869:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:3.0:1790391396.473902:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:10480:x1877361169552128:12345-192.168.202.28@tcp:36:mkdir.0 00010000:00010000:3.0:1790391396.473944:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391396.474025:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e0f72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0019 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.474113:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b5d77800) 00010000:00010000:3.0:1790391396.474140:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391396.474223:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.476466:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.476481:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.476544:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.476552:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.476559:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.477104:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.477115:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.477122:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391396.477137:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b531379 reply state 000000003a65bae2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.477147:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.477153:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e51821ba900) 00010000:00010000:3.0:1790391396.477162:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391396.477166:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790391396.477172:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790391396.477179:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.477186:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10d0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.477193:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.477199:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391396.477203:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.477211:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.477220:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821ba000) 00010000:00010000:3.0:1790391396.477223:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391396.480646:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10d0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.480671:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391396.480716:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b531379 reply state 000000003a65bae2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.480732:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.480754:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e51821ba700) 00010000:00010000:3.0:1790391396.480758:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391396.480763:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1790391396.484521:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:10480:x1877361169552128:12345-192.168.202.28@tcp:36:mkdir.0 Request processed in 10634us (10798us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790391396.484546:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:3.0:1790391396.513691:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391396.513798:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169552256 00000100:00100000:1.0:1790391396.513808:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169552256 00000100:00100000:1.0:1790391396.513866:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:1.0:1790391396.513897:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:10483:x1877361169552256:12345-192.168.202.28@tcp:101:chmod.0 00010000:00010000:1.0:1790391396.513923:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391396.513951:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e10e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00ac expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.514018:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e10ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.514034:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e10ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.514047:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e10ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391396.514094:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790391396.514098:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391396.514134:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e10ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.514158:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e10e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00ac expref: 9 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.514184:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e10ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00ac expref: 8 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.514192:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283e7c800) 00010000:00010000:1.0:1790391396.514195:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391396.514199:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086400, rc 0) 00000100:00100000:1.0:1790391396.514266:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:10483:x1877361169552256:12345-192.168.202.28@tcp:101:chmod.0 Request processed in 391us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391396.514273:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:1.0:1790391396.518646:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.518735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169552512 00000100:00100000:3.0:1790391396.518745:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169552512 00000100:00100000:3.0:1790391396.518810:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:3.0:1790391396.518821:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:10483:x1877361169552512:12345-192.168.202.28@tcp:36:chmod.0 00010000:00010000:3.0:1790391396.518905:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391396.518932:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e10ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00ac expref: 8 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.518955:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283e7c800) 00010000:00010000:3.0:1790391396.518966:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391396.518991:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.519006:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.519015:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391396.519216:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000426fe5a5 reply state 00000000393b4453 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.519241:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.519247:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821ba000) 00010000:00010000:3.0:1790391396.519250:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790391396.519253:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790391396.519261:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790391396.519337:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:10483:x1877361169552512:12345-192.168.202.28@tcp:36:chmod.0 Request processed in 518us (702us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790391396.519345:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:1.0:1790391396.543954:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.544111:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169552640 00000100:00100000:3.0:1790391396.544122:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169552640 00000100:00100000:3.0:1790391396.544180:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:3.0:1790391396.544190:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:10484:x1877361169552640:12345-192.168.202.28@tcp:101:chown.0 00010000:00010000:3.0:1790391396.544216:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391396.544247:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e10fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00b3 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.544314:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e1101 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.544328:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e1101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.544339:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e1101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391396.544392:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790391396.544396:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391396.544450:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e1101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.544478:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e10fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00b3 expref: 11 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.544497:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e1101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00b3 expref: 10 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.544507:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821ba000) 00010000:00010000:3.0:1790391396.544510:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391396.544514:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52813a2c00, rc 0) 00000100:00100000:3.0:1790391396.544577:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:10484:x1877361169552640:12345-192.168.202.28@tcp:101:chown.0 Request processed in 388us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391396.544584:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:3.0:1790391396.547514:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391396.547606:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169552768 00000100:00100000:0.0:1790391396.547616:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169552768 00000100:00100000:0.0:1790391396.547676:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:0.0:1790391396.547685:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:10484:x1877361169552768:12345-192.168.202.28@tcp:101:chown.0 00010000:00010000:0.0:1790391396.547704:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391396.547727:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.547789:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e110f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.547803:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e110f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.547833:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e110f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.547846:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1116 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.547853:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.547859:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.547968:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e111d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.547977:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e111d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.547984:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e111d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391396.548024:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790391396.548028:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391396.548047:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e111d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548059:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e110f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548065:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e110f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548081:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e110f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548087:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefa00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391396.548091:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e110f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548099:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e110f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548110:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821ba000) 00010000:00010000:0.0:1790391396.548113:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391396.548117:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e110f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548123:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e110f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548134:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548140:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1116 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548145:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548150:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391396.548152:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548165:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1116 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548173:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e51821ba700) 00010000:00010000:0.0:1790391396.548175:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391396.548178:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1116 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548184:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1116 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548207:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00ba expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548218:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e111d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00ba expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.548225:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e51821ba900) 00010000:00010000:0.0:1790391396.548227:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391396.548230:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eeee00, rc 0) 00000100:00100000:0.0:1790391396.548294:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:10484:x1877361169552768:12345-192.168.202.28@tcp:101:chown.0 Request processed in 609us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391396.548302:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:1.0:1790391396.552200:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391396.552794:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169552896 00000100:00100000:0.0:1790391396.552806:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169552896 00000100:00100000:0.0:1790391396.552865:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:0.0:1790391396.552908:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:10484:x1877361169552896:12345-192.168.202.28@tcp:900:chown.0 00000100:00100000:0.0:1790391396.553019:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:10484:x1877361169552896:12345-192.168.202.28@tcp:900:chown.0 Request processed in 144us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391396.553027:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:0.0:1790391396.567937:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.568397:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169553152 00000100:00100000:3.0:1790391396.568409:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169553152 00000100:00100000:3.0:1790391396.568473:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:3.0:1790391396.568483:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:10484:x1877361169553152:12345-192.168.202.28@tcp:36:chown.0 00010000:00010000:3.0:1790391396.568540:0:10091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391396.568567:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e111d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00ba expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.568584:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e51821ba900) 00010000:00010000:3.0:1790391396.568588:0:10091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391396.568610:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.568634:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.568641:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391396.571024:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1790391396.571092:0:10091:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004719d35a reply state 00000000f72d663c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.571115:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.571125:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e51821ba900) 00010000:00010000:3.0:1790391396.571128:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790391396.571133:0:10091:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790391396.571144:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790391396.571167:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571175:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571182:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571187:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391396.571192:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571208:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571219:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e51821ba700) 00010000:00010000:2.0:1790391396.571221:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391396.571224:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571230:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e10d7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571266:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571273:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571278:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571284:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391396.571287:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571293:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.571300:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e51821ba900) 00010000:00010000:2.0:1790391396.571303:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391396.571306:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1790391396.571365:0:10091:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790391396.571394:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:10484:x1877361169553152:12345-192.168.202.28@tcp:36:chown.0 Request processed in 2910us (3464us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790391396.571411:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 28 00010000:00010000:0.0:1790391396.571511:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.571518:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.571524:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.571529:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391396.571531:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.571537:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.571545:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e51821ba900) 00010000:00010000:0.0:1790391396.571547:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790391396.571550:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.571555:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e1124 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.572885:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e10de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.572922:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.572928:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.572935:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.572940:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391396.572945:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.572951:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.572961:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821ba000) 00010000:00010000:2.0:1790391396.572964:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790391396.572968:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.572973:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e10f3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391396.593265:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391396.593427:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169553280 00000100:00100000:1.0:1790391396.593544:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169553280 00000100:00100000:1.0:1790391396.593602:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:1.0:1790391396.593610:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:10485:x1877361169553280:12345-192.168.202.28@tcp:101:touch.500 00010000:00010000:1.0:1790391396.593631:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391396.593659:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e112b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391396.598609:0:6512:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4884us 00010000:00010000:1.0:1790391396.614755:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1132 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.614778:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1132 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.614806:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1132 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.614824:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1139 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.614833:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.614839:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.614996:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1140 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615005:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1140 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615012:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1140 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391396.615045:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790391396.615049:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391396.615085:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1140 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615098:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1132 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615104:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1132 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615120:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1132 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615126:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391396.615131:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1132 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615140:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1132 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615154:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821ba000) 00010000:00010000:1.0:1790391396.615158:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391396.615163:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615169:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615182:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615188:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1139 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615194:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1139 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615200:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391396.615203:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1139 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615218:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1139 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615226:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e5290030100) 00010000:00010000:1.0:1790391396.615228:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391396.615231:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1139 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615238:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1139 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615283:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e112b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00c1 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615299:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1140 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00c1 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.615305:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e5290030300) 00010000:00010000:1.0:1790391396.615307:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790391396.615310:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086000, rc 0) 00000100:00100000:1.0:1790391396.615396:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:10485:x1877361169553280:12345-192.168.202.28@tcp:101:touch.500 Request processed in 21785us (22140us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391396.615511:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:0.0:1790391396.624516:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.624626:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169553536 00000100:00100000:3.0:1790391396.624640:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169553536 00000100:00100000:3.0:1790391396.624705:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:3.0:1790391396.624717:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:10485:x1877361169553536:12345-192.168.202.28@tcp:101:touch.500 00010000:00010000:3.0:1790391396.624743:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391396.624766:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e1147 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00c8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.624962:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e114e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.624976:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e114e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.624987:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e114e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625001:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625008:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625014:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391396.625392:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1790391396.625596:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e115c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625606:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e115c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625614:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e115c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625649:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e114e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625666:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e114e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625672:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e114e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625677:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391396.625681:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e114e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625689:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e114e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625702:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e5290030300) 00010000:00010000:3.0:1790391396.625704:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391396.625709:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e114e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625715:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e114e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391396.625729:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db6c3786 reply state 000000008f0a866e transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625741:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625747:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff9e51821ba800) 00010000:00010000:3.0:1790391396.625750:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391396.625753:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790391396.625782:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e1147 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00c8 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625804:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e115c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00c8 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.625811:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e51821ba900) 00010000:00010000:3.0:1790391396.625813:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391396.625816:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031800, rc 0) 00000100:00100000:3.0:1790391396.625900:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:10485:x1877361169553536:12345-192.168.202.28@tcp:101:touch.500 Request processed in 1162us (1371us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790391396.625908:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:0.0:1790391396.631709:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.631819:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169553792 00000100:00100000:3.0:1790391396.631840:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169553792 00000100:00100000:3.0:1790391396.631956:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:3.0:1790391396.631968:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:10485:x1877361169553792:12345-192.168.202.28@tcp:36:touch.500 00010000:00010000:3.0:1790391396.632030:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391396.632056:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e115c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00c8 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.632076:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e51821ba900) 00010000:00010000:3.0:1790391396.632105:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391396.632182:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.632195:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.632205:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391396.632315:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a13ce385 reply state 000000002e8dc0da transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.632328:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.632335:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e51821ba700) 00010000:00010000:3.0:1790391396.632337:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391396.632340:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391396.632445:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:10485:x1877361169553792:12345-192.168.202.28@tcp:36:touch.500 Request processed in 478us (746us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1790391396.632452:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:0.0:1790391396.635060:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.635191:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169553920 00000100:00100000:3.0:1790391396.635209:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169553920 00000100:00100000:3.0:1790391396.635294:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:3.0:1790391396.635306:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:10485:x1877361169553920:12345-192.168.202.28@tcp:101:touch.500 00010000:00010000:3.0:1790391396.635339:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391396.635383:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e1171 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00cf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.635468:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e1171 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00cf expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.635490:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e1171 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00cf expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.635517:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e51821ba700) 00010000:00010000:3.0:1790391396.635545:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391396.635551:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d200, rc 0) 00000100:00100000:3.0:1790391396.635634:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+12:10485:x1877361169553920:12345-192.168.202.28@tcp:101:touch.500 Request processed in 330us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391396.635642:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:2.0:1790391396.642223:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.642276:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169554048 00000100:00100000:3.0:1790391396.642287:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169554048 00000100:00100000:0.0:1790391396.642454:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:0.0:1790391396.642465:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2380:x1877361169554048:12345-192.168.202.28@tcp:8:touch.500 00010000:00080000:0.0:1790391396.642603:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:0.0:1790391396.642636:0:8429:0:(genops.c:1385:class_connect()) connect: client 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d, cookie 0x2b1b7949f13e1178 00002000:00100000:0.0:1790391396.642650:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d/ffff9e51838d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391396.642764:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790391396.642901:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790391396.642947:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e51838d6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391396.643048:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2380:x1877361169554048:12345-192.168.202.28@tcp:8:touch.500 Request processed in 582us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391396.643058:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:0.0:1790391396.644990:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.645144:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169554176 00000100:00100000:3.0:1790391396.645158:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169554176 00000100:00100000:3.0:1790391396.645275:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:3.0:1790391396.645289:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:0:x1877361169554176:12345-192.168.202.28@tcp:2:touch.500 00000100:00080000:1.0:1790391396.645709:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1790391396.655379:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1790391396.655402:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000100:00100000:3.0:1790391396.656462:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:0:x1877361169554176:12345-192.168.202.28@tcp:2:touch.500 Request processed in 11161us (11467us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790391396.656479:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:3.0:1790391396.664328:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391396.664571:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169554432 00000100:00100000:1.0:1790391396.664586:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169554432 00000100:00100000:1.0:1790391396.664995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:1.0:1790391396.665009:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+12:10485:x1877361169554432:12345-192.168.202.28@tcp:35:touch.500 00000100:00100000:1.0:1790391396.665459:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:10485:x1877361169554432:12345-192.168.202.28@tcp:35:touch.500 Request processed in 451us (1146us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790391396.665468:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:2.0:1790391396.688617:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.689336:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169554560 00000100:00100000:3.0:1790391396.689362:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169554560 00000100:00100000:2.0:1790391396.690138:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:2.0:1790391396.690156:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:10486:x1877361169554560:12345-192.168.202.28@tcp:101:rm.0 00010000:00010000:2.0:1790391396.690189:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391396.690217:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c400/0x2b1b7949f13e117f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.690307:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1186 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.690325:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.690340:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391396.690424:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790391396.690428:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391396.690486:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.690519:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c400/0x2b1b7949f13e117f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00d6 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.690540:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1186 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00d6 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.690550:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e5290030300) 00010000:00010000:2.0:1790391396.690554:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391396.690558:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c200, rc 0) 00000100:00100000:2.0:1790391396.690658:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:10486:x1877361169554560:12345-192.168.202.28@tcp:101:rm.0 Request processed in 506us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391396.690681:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:2.0:1790391396.697367:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.698184:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169554816 00000100:00100000:3.0:1790391396.698196:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169554816 00000100:00100000:3.0:1790391396.698264:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 34 00000100:00100000:3.0:1790391396.698274:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:10486:x1877361169554816:12345-192.168.202.28@tcp:101:rm.0 00010000:00010000:3.0:1790391396.698298:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391396.698322:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e118d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00dd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391396.701104:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790391396.701375:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e118d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00dd expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.701410:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821ba000) 00010000:00010000:3.0:1790391396.701413:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391396.701420:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763cc00/0x2b1b7949f13e118d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00dd expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.701439:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763cc00, rc 0) 00000100:00100000:3.0:1790391396.702299:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:10486:x1877361169554816:12345-192.168.202.28@tcp:101:rm.0 Request processed in 4020us (4952us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1790391396.702311:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 34 00000100:00100000:3.0:1790391396.713336:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391396.713563:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169554944 00000100:00100000:0.0:1790391396.713578:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169554944 00000100:00100000:0.0:1790391396.713721:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:0.0:1790391396.713733:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:10486:x1877361169554944:12345-192.168.202.28@tcp:37:rm.0 00000100:00100000:0.0:1790391396.719794:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:10486:x1877361169554944:12345-192.168.202.28@tcp:37:rm.0 Request processed in 6047us (6458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391396.719813:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:2.0:1790391396.732013:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391396.732134:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169555200 00000100:00100000:1.0:1790391396.732149:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169555200 00000100:00100000:1.0:1790391396.732212:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:1.0:1790391396.732224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:10486:x1877361169555200:12345-192.168.202.28@tcp:35:rm.0 00000100:00100000:1.0:1790391396.732668:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:10486:x1877361169555200:12345-192.168.202.28@tcp:35:rm.0 Request processed in 444us (670us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790391396.732678:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:3.0:1790391396.738238:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391396.739308:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169555456 00000100:00100000:1.0:1790391396.739323:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169555456 00000100:00100000:1.0:1790391396.739429:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:1.0:1790391396.739443:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:10486:x1877361169555456:12345-192.168.202.28@tcp:101:rm.0 00010000:00010000:1.0:1790391396.739477:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391396.742228:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e119b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.743238:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e11a2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.743261:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e11a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.743275:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e11a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391396.743290:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790391396.744903:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e119b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00e4 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.745309:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e11a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00e4 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.745323:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e5290030300) 00010000:00010000:1.0:1790391396.745326:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790391396.745331:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086c00, rc 0) 00000100:00100000:1.0:1790391396.745453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:10486:x1877361169555456:12345-192.168.202.28@tcp:101:rm.0 Request processed in 6010us (7232us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790391396.745464:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:2.0:1790391396.755862:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391396.756064:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169555584 00000100:00100000:1.0:1790391396.756078:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169555584 00000100:00100000:1.0:1790391396.756203:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 36 00000100:00100000:1.0:1790391396.756217:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:10486:x1877361169555584:12345-192.168.202.28@tcp:41:rm.0 00000004:00000024:1.0:1790391396.756304:0:10091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1790391396.756416:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:10486:x1877361169555584:12345-192.168.202.28@tcp:41:rm.0 Request processed in 202us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391396.756424:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 36 00000100:00100000:2.0:1790391396.765623:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391396.765867:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169555712 00000100:00100000:0.0:1790391396.765920:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169555712 00000100:00100000:0.0:1790391396.766141:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 37 00000100:00100000:0.0:1790391396.766154:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:10486:x1877361169555712:12345-192.168.202.28@tcp:101:rm.0 00010000:00010000:0.0:1790391396.766203:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391396.766232:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef600/0x2b1b7949f13e11b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.766319:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e11b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.766338:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e11b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.766365:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e11b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.766380:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e11be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.766389:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e11be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.766396:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e11be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769086:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeec00/0x2b1b7949f13e11c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769119:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeec00/0x2b1b7949f13e11c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769134:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeec00/0x2b1b7949f13e11c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391396.769214:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790391396.769240:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391396.769270:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeec00/0x2b1b7949f13e11c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769285:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeec00/0x2b1b7949f13e11c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769294:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e11b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769301:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e11b7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769307:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e11b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769313:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391396.769318:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e11b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769326:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e11b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769340:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e5290030300) 00010000:00010000:0.0:1790391396.769344:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391396.769358:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e11b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769366:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e11b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769384:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e11be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769401:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e11be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769407:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e11be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769412:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391396.769415:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e11be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769421:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e11be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769431:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff9e51821ba800) 00010000:00010000:0.0:1790391396.769434:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391396.769437:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e11be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769443:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e11be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769629:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef600/0x2b1b7949f13e11b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00eb expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769646:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeec00/0x2b1b7949f13e11c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00eb expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391396.769654:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e51821ba700) 00010000:00010000:0.0:1790391396.769656:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391396.769665:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eeec00, rc 0) 00000100:00100000:0.0:1790391396.770234:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:10486:x1877361169555712:12345-192.168.202.28@tcp:101:rm.0 Request processed in 4077us (4623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391396.770245:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 37 00000100:00100000:0.0:1790391396.780643:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391396.781050:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169555968 00000100:00100000:3.0:1790391396.781063:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169555968 00000100:00100000:3.0:1790391396.781145:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 38 00000100:00100000:3.0:1790391396.781159:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:10486:x1877361169555968:12345-192.168.202.28@tcp:36:rm.0 00010000:00010000:3.0:1790391396.781260:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790391396.781586:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeec00/0x2b1b7949f13e11c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00eb expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.781623:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e1171 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00cf expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.781636:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e51821ba700) 00010000:00010000:3.0:1790391396.781648:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1186 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00d6 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391396.782203:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e5290030300) 00010000:00010000:3.0:1790391396.782209:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391396.782679:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e11cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.782698:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e11cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.782711:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e11cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.782726:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.782743:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.782750:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.783130:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e11da lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.783141:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e11da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.783149:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e11da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391396.783728:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1790391396.783744:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310150866182ns, next at 311150862907ns, rc = 0 00010000:00010000:2.0:1790391396.783809:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.783819:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.783840:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.783849:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.783856:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.783863:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784052:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391396.784086:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e11da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784092:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e11da lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784099:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e11da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784105:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391396.784122:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e11da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784131:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e11da lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784144:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e51821ba700) 00010000:00010000:2.0:1790391396.784148:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790391396.784153:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e11da lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784160:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e11da lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784180:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e11cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784186:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e11cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784192:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e11cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784197:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391396.784200:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e11cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784206:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e11cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784214:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e5290030300) 00010000:00010000:2.0:1790391396.784216:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391396.784226:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e11cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784233:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e11cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391396.784244:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a29b16e reply state 000000009aa9a1be transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784256:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391396.784262:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff9e51821ba800) 00010000:00010000:2.0:1790391396.784264:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790391396.784267:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790391396.784486:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391396.784504:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.784512:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391396.784516:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.784533:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.784543:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e51821ba700) 00010000:00010000:1.0:1790391396.784546:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790391396.784549:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.784554:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e11e1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.784566:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391396.784568:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391396.784570:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391396.784680:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:10486:x1877361169555968:12345-192.168.202.28@tcp:36:rm.0 Request processed in 3518us (4047us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790391396.784691:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 38 00000100:00100000:2.0:1790391396.791447:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391396.791642:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169556224 00000100:00100000:1.0:1790391396.791656:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169556224 00000100:00100000:1.0:1790391396.791856:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:1.0:1790391396.791870:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:10486:x1877361169556224:12345-192.168.202.28@tcp:35:rm.0 00000100:00100000:1.0:1790391396.792507:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:10486:x1877361169556224:12345-192.168.202.28@tcp:35:rm.0 Request processed in 638us (1074us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790391396.792518:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:2.0:1790391396.799070:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391396.800184:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169556480 00000100:00100000:1.0:1790391396.800203:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169556480 00000100:00100000:1.0:1790391396.800284:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:1.0:1790391396.800428:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:10486:x1877361169556480:12345-192.168.202.28@tcp:36:rm.0 00010000:00010000:1.0:1790391396.800596:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790391396.800631:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e11a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00e4 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.800807:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1140 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00c1 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801139:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e5290030300) 00010000:00010000:1.0:1790391396.801166:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52813a2c00/0x2b1b7949f13e1101 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00b3 expref: 17 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801180:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821ba000) 00010000:00010000:1.0:1790391396.801210:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391396.801241:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e11e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801257:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e11e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801268:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e11e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801281:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801288:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801312:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801430:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e11f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801454:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e11f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801462:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e11f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391396.801793:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790391396.801812:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e11f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801820:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e11f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801839:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e11f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801845:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391396.801852:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e11f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801861:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e11f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.801871:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e5290030400) 00010000:00010000:1.0:1790391396.801874:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790391396.801935:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e11f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.802078:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e11f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.802103:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e11e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.802118:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e11e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.802123:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e11e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.802128:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391396.802131:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e11e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.802136:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e11e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.802145:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5290030100) 00010000:00010000:1.0:1790391396.802147:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391396.802149:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e11e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.802155:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e11e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391396.802167:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033dc69ee reply state 0000000005aa99d7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.802178:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391396.802185:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e5290030700) 00010000:00010000:1.0:1790391396.802187:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391396.802190:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391396.802298:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:10486:x1877361169556480:12345-192.168.202.28@tcp:36:rm.0 Request processed in 1999us (3372us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790391396.802314:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 39 00010000:00010000:3.0:1790391397.320941:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391397.896325:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186417408:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.896435:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.896495:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186417920:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.896525:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.896552:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186418432:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.896573:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.896602:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1790391397.896607:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186417024:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.896640:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.896672:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186417536:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.896701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.896720:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186418048:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.896744:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.896763:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186418560:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.896786:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.896818:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186417152:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.896844:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.896865:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186417664:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.896932:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.896954:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186418176:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.896978:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.896998:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790391397.897003:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186417280:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.897025:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.897044:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186417792:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.897066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.897077:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186418304:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.897115:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391397.897155:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186417920 00000100:00100000:2.0:1790391397.897166:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186417920 00000100:00100000:2.0:1790391397.897238:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186418432 00000100:00100000:2.0:1790391397.897242:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186418432 00000100:00100000:2.0:1790391397.897257:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186418048 00000100:00100000:2.0:1790391397.897260:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186418048 00000100:00100000:2.0:1790391397.897273:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186418560 00000100:00100000:2.0:1790391397.897283:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186418560 00000100:00100000:2.0:1790391397.897305:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790391397.897315:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186417920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.897398:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186417920:12345-0@lo:400:kworker.0 Request processed in 83us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.897405:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790391397.897424:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790391397.897429:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186418432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.897460:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186418432:12345-0@lo:400:kworker.0 Request processed in 31us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.897466:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790391397.897476:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790391397.897482:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186418048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.897506:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186418048:12345-0@lo:400:kworker.0 Request processed in 25us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.897512:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790391397.897522:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790391397.897529:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186418560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.897555:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186418560:12345-0@lo:400:kworker.0 Request processed in 27us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.897561:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790391397.897589:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186417024 00000100:00100000:2.0:1790391397.897593:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186417024 00000100:00100000:2.0:1790391397.897622:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1790391397.897630:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186417024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.897662:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186417024:12345-0@lo:400:kworker.0 Request processed in 34us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.897676:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1790391397.897713:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186417536 00000100:00100000:2.0:1790391397.897718:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186417536 00000100:00100000:2.0:1790391397.897744:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186417280 00000100:00100000:2.0:1790391397.897746:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186417280 00000100:00100000:2.0:1790391397.897757:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790391397.897762:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186417536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.897797:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186417536:12345-0@lo:400:kworker.0 Request processed in 34us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.897804:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790391397.897814:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790391397.897820:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186417280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.897850:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186417280:12345-0@lo:400:kworker.0 Request processed in 31us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.897856:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790391397.897911:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186417408 00000100:00100000:2.0:1790391397.897915:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186417408 00000100:00100000:2.0:1790391397.897935:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186417152 00000100:00100000:2.0:1790391397.897937:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186417152 00000100:00100000:2.0:1790391397.897947:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186417664 00000100:00100000:2.0:1790391397.897949:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186417664 00000100:00100000:2.0:1790391397.897961:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186418176 00000100:00100000:2.0:1790391397.897963:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186418176 00000100:00100000:2.0:1790391397.897974:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186417792 00000100:00100000:2.0:1790391397.897977:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186417792 00000100:00100000:2.0:1790391397.897987:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186418304 00000100:00100000:2.0:1790391397.897990:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186418304 00000100:00100000:2.0:1790391397.898005:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1790391397.898011:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186417408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186417408:12345-0@lo:400:kworker.0 Request processed in 43us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.898061:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1790391397.898074:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1790391397.898080:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186417152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898105:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186417152:12345-0@lo:400:kworker.0 Request processed in 25us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.898111:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1790391397.898121:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1790391397.898126:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186417664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898154:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186417664:12345-0@lo:400:kworker.0 Request processed in 28us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.898159:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1790391397.898168:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790391397.898174:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186418176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898199:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186418176:12345-0@lo:400:kworker.0 Request processed in 25us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.898205:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790391397.898214:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790391397.898219:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186417792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898249:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186417792:12345-0@lo:400:kworker.0 Request processed in 30us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.898255:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790391397.898266:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1790391397.898271:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186418304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898307:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186418304:12345-0@lo:400:kworker.0 Request processed in 35us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391397.898313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1790391397.898407:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186417280:0@lo:400:kworker.0 00010000:00080000:2.0:1790391397.898426:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838a1880 x1877361186417792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391397.898438:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186417792:0@lo:400:kworker.0 00010000:00080000:2.0:1790391397.898449:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838a0000 x1877361186418304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391397.898457:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186418304:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898469:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186417152:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898479:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186417664:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898489:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186418176:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898539:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186417024:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898550:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186417536:0@lo:400:kworker.0 00010000:00080000:2.0:1790391397.898562:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838a0380 x1877361186418048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391397.898570:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186418048:0@lo:400:kworker.0 00010000:00080000:2.0:1790391397.898581:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838a1500 x1877361186418560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391397.898590:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186418560:0@lo:400:kworker.0 00000100:00100000:2.0:1790391397.898613:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186417408:0@lo:400:kworker.0 00010000:00080000:2.0:1790391397.898626:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838a3100 x1877361186417920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391397.898634:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186417920:0@lo:400:kworker.0 00010000:00080000:2.0:1790391397.898644:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838a0a80 x1877361186418432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391397.898652:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186418432:0@lo:400:kworker.0 00000100:00080000:1.0:1790391397.899080:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391397.899086:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391397.899090:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391397.899093:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790391398.346001:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391398.415758:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186418688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391398.415861:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391398.416471:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186418688 00000100:00100000:2.0:1790391398.416485:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186418688 00000100:00100000:2.0:1790391398.416562:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790391398.416574:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186418688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391398.417842:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391398.418422:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186418688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1845us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391398.418437:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1790391398.420868:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51832a7b80 x1877361186418688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391398.420951:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186418688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391398.420983:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186418816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391398.421069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391398.421163:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186418816 00000100:00100000:0.0:1790391398.421171:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186418816 00000100:00100000:0.0:1790391398.421232:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790391398.421243:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186418816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391398.421273:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391398.421343:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186418816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391398.421351:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1790391398.421385:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183894000 x1877361186418816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391398.421398:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186418816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391399.306457:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391399.306515:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391399.306541:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391399.306564:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391399.306588:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391399.306612:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391399.306654:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169556864 00000100:00100000:1.0:1790391399.306668:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169556864 00000100:00100000:1.0:1790391399.306736:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169557120 00000100:00100000:1.0:1790391399.306740:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169557120 00000100:00100000:1.0:1790391399.306757:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169556736 00000100:00100000:1.0:1790391399.306759:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169556736 00000100:00100000:1.0:1790391399.306772:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169557248 00000100:00100000:1.0:1790391399.306775:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169557248 00000100:00100000:1.0:1790391399.306792:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 209 00000100:00100000:1.0:1790391399.306804:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169556864:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391399.306933:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169556864:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 129us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391399.306940:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 209 00000100:00100000:1.0:1790391399.306961:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 210 00000100:00100000:1.0:1790391399.306968:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169557120:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391399.306991:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169557120:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391399.307008:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 210 00000100:00100000:1.0:1790391399.307018:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 211 00000100:00100000:1.0:1790391399.307023:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:2384:x1877361169556736:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391399.307049:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:2384:x1877361169556736:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391399.307055:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 211 00000100:00100000:1.0:1790391399.307064:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 212 00000100:00100000:1.0:1790391399.307070:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169557248:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391399.307091:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169557248:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391399.307097:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 212 00000100:00080000:1.0:1790391399.307114:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391399.307119:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391399.307290:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169556608 00000100:00100000:2.0:1790391399.307296:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169556608 00000100:00100000:2.0:1790391399.307351:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 337 00000100:00100000:2.0:1790391399.307359:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169556608:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391399.307396:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169556608:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 39us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391399.307403:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 337 00000100:00100000:2.0:1790391399.307446:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169556992 00000100:00100000:2.0:1790391399.307450:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169556992 00000100:00100000:2.0:1790391399.307487:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 100 00000100:00100000:2.0:1790391399.307494:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169556992:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391399.307525:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169556992:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 31us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391399.307531:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 100 00000100:00080000:2.0:1790391399.307700:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790391399.378496:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391399.433168:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186418944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391399.433272:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391399.433542:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391399.433617:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186419072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391399.433728:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391399.433780:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186419072 00000100:00100000:2.0:1790391399.433790:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186419072 00000100:00100000:2.0:1790391399.433852:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790391399.433863:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186419072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391399.433947:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790391399.434001:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186419072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391399.434009:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790391399.434072:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186419072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391399.434202:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186418944 00000100:00100000:3.0:1790391399.434207:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186418944 00000100:00100000:3.0:1790391399.434257:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790391399.434265:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186418944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391399.434302:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391399.434354:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186418944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391399.434361:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1790391399.435237:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51832a7b80 x1877361186418944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391399.435262:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186418944:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790391399.435377:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391399.436303:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186419200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391399.436393:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1790391399.438718:0:8832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312805836187ns, next at 313805831502ns, rc = 0 00000100:00100000:2.0:1790391399.442044:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186419200 00000100:00100000:2.0:1790391399.442063:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186419200 00000100:00100000:2.0:1790391399.442163:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790391399.442175:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186419200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391399.442211:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391399.444788:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186419200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 373us (6153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391399.444811:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1790391399.444868:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790391399.445818:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51832a7b80 x1877361186419200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391399.445852:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186419200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790391400.393329:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790391400.844982:0:13674:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1790391401.416605:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391401.487813:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186419328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391401.487944:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391401.488438:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186419328 00000100:00100000:2.0:1790391401.488452:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186419328 00000100:00100000:2.0:1790391401.488526:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790391401.488539:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186419328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391401.488587:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790391401.488663:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186419328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391401.488671:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790391401.488738:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186419328:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1790391402.033498:0:13722:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffddd54a40 20000000:00000080:3.0:1790391402.033521:0:13722:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e51832a9c00 uarg=0000000000000000 20000000:01000000:3.0:1790391402.033579:0:13722:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790391402.033588:0:13722:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790391402.033594:0:13722:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1790391402.036067:0:13723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1790391402.036458:0:13722:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1790391402.043524:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1790391402.043591:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1790391402.043631:0:13722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1790391402.043651:0:13722:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790391402.043680:0:13722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.043706:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e108a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b009e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.043716:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e1091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00a5 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.043723:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e109f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e1098 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.043727:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5280030400/0x2b1b7949f13e10ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e10a6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.043731:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5183086e00/0x2b1b7949f13e10bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e10b4 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.043735:0:13722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e10c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e10c2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.043741:0:13722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.043789:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e10c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e10c2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.043802:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e10c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e10c2 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391402.043825:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186419456:0@lo:104: 00000100:00100000:2.0:1790391402.043981:0:13722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391402.044055:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1790391402.044059:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5183086e00/0x2b1b7949f13e10bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e10b4 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.044067:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5183086e00/0x2b1b7949f13e10bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e10b4 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391402.044072:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186419456 00000100:00100000:2.0:1790391402.044075:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186419584:0@lo:104: 00000100:00100000:0.0:1790391402.044081:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186419456 00000100:00100000:2.0:1790391402.044097:0:13722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391402.044130:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5280030400/0x2b1b7949f13e10ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e10a6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391402.044134:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186419584 00000100:00100000:0.0:1790391402.044137:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186419584 00010000:00010000:2.0:1790391402.044138:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5280030400/0x2b1b7949f13e10ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e10a6 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391402.044146:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186419712:0@lo:104: 00000100:00100000:0.0:1790391402.044157:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790391402.044169:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:13722:x1877361186419456:12345-0@lo:104: 00000100:00100000:2.0:1790391402.044174:0:13722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391402.044190:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e109f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e1098 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.044194:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.044198:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e109f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e1098 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391402.044206:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186419840:0@lo:104: 00000100:00100000:2.0:1790391402.044230:0:13722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391402.044252:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e1091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00a5 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.044268:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1790391402.044274:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e1091 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00a5 expref: 12 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391402.044274:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:13722:x1877361186419456:12345-0@lo:104: Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391402.044283:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391402.044284:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186419968:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391402.044336:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186419712 00000100:00100000:0.0:1790391402.044340:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186419712 00000100:00100000:0.0:1790391402.044352:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186419840 00000100:00100000:0.0:1790391402.044354:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186419840 00000100:00100000:0.0:1790391402.044366:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790391402.044371:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:13722:x1877361186419584:12345-0@lo:104: 00010000:00010000:0.0:1790391402.044381:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.044416:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790391402.044420:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+5:13722:x1877361186419584:12345-0@lo:104: Request processed in 50us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391402.044426:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790391402.044437:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790391402.044442:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:13722:x1877361186419712:12345-0@lo:104: 00010000:00010000:0.0:1790391402.044450:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.044474:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790391402.044478:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+4:13722:x1877361186419712:12345-0@lo:104: Request processed in 36us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391402.044493:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1790391402.044505:0:13722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e108a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b009e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391402.044505:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790391402.044511:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:13722:x1877361186419840:12345-0@lo:104: 00010000:00010000:2.0:1790391402.044514:0:13722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e108a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b009e expref: 12 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.044518:0:6496:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391402.044522:0:13722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186420096:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391402.044553:0:13722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528968cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391402.044582:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186419456:0@lo:104: 00000100:00100000:2.0:1790391402.044590:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186419584:0@lo:104: 00000100:00100000:2.0:1790391402.044596:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186419712:0@lo:104: 00010000:00010000:1.0:1790391402.044664:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790391402.044666:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1790391402.044672:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391402.044674:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+3:13722:x1877361186419840:12345-0@lo:104: Request processed in 162us (442us total) trans 0 rc 0/0 00010000:00010000:1.0:1790391402.044688:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086200 already unused, calling callback (ffffffffc124dc20) 00000100:00100000:0.0:1790391402.044692:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 10000000:00010000:1.0:1790391402.044695:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.044704:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.044713:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:1.0:1790391402.044726:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391402.044734:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391402.044954:0:13724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391402.044962:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.045294:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.045312:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391402.045341:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.045349:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5183086200/0x2b1b7949f13e10c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e10c9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.045362:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391402.045365:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.045461:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391402.045467:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.045477:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391402.045485:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391402.045492:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391402.045526:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.045542:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391402.045551:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.045557:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefe00/0x2b1b7949f13e10b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e10bb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.045567:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391402.045569:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391402.045571:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391402.045949:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186420224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391402.045972:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391402.045982:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391402.045983:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186420352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391402.045993:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391402.046000:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391402.046017:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1790391402.046020:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391402.046064:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.046071:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790391402.046099:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790391402.046101:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.046112:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee400/0x2b1b7949f13e1098 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e109f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.046128:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391402.046130:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391402.046134:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391402.046153:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186420224 00000100:00100000:1.0:1790391402.046160:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186420224 00010000:00010000:1.0:1790391402.046192:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e10c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e10c2 expref: 24 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391402.046221:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186420352 00000100:00100000:1.0:1790391402.046224:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186420352 00010000:00010000:1.0:1790391402.046237:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5183086e00/0x2b1b7949f13e10bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e10b4 expref: 25 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391402.046257:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391402.046264:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+25:3639:x1877361186420224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391402.046279:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391402.046285:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e10c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e10c2 expref: 25 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.046309:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e10c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e10c2 expref: 25 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.046338:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eef200/0x2b1b7949f13e10c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e10c2 expref: 25 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.046351:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391402.047657:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186420224:12345-0@lo:103:ldlm_bl.0 Request processed in 1383us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391402.047671:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391402.047710:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790391402.047723:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:3640:x1877361186420352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391402.047740:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391402.047748:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5183086e00/0x2b1b7949f13e10bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e10b4 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.047765:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5183086e00/0x2b1b7949f13e10bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e10b4 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.047796:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183086e00/0x2b1b7949f13e10bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e10b4 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.047812:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391402.047872:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:3640:x1877361186420352:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (1776us total) trans 0 rc 0/0 00000004:00080000:3.0:1790391402.047996:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1790391402.048021:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1790391402.048030:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1790391402.048083:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186420352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391402.048484:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790391402.048534:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186420480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391402.048596:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391402.048653:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391402.048660:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186420608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790391402.048663:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186419840:0@lo:104: 00000100:00100000:1.0:1790391402.048712:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391402.048760:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186420480 00000100:00100000:1.0:1790391402.048768:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186420480 00010000:00010000:0.0:1790391402.049640:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049656:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049664:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049670:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391402.049676:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049686:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049708:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff9e51821ba800) 00010000:00010000:0.0:1790391402.049723:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391402.049730:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049739:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030600/0x2b1b7949f13e1155 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049763:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.049765:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e109f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e1098 expref: 22 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049772:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049778:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049783:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391402.049786:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049793:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049800:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e51821ba700) 00010000:00010000:0.0:1790391402.049803:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391402.049806:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049813:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e116a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049853:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049871:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049895:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049900:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391402.049904:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049910:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049919:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff9e51821ba800) 00010000:00010000:0.0:1790391402.049922:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391402.049925:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049931:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e11d3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049954:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049962:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049969:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.049975:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087200 already unused, calling callback (ffffffffc185e4f0) 00000100:00100000:1.0:1790391402.049979:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1790391402.049988:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391402.049995:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:3637:x1877361186420480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391402.050003:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.050014:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391402.050015:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e5290030700) 00010000:00010000:0.0:1790391402.050021:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391402.050027:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e109f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e1098 expref: 22 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.050028:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.050048:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e11ef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.050051:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e109f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e1098 expref: 22 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.050074:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e109f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e1098 expref: 22 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.050088:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391402.050153:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:3637:x1877361186420480:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391402.050160:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790391402.050225:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186420224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391402.051271:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186420480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391402.055803:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391402.055814:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391402.055817:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391402.055828:0:13724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.055970:0:13724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391402.055976:0:13724:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391402.056002:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00010000:00010000:1.0:1790391402.056015:0:13724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391402.056025:0:13724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391402.056031:0:13724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790391402.056089:0:13724:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.056096:0:13724:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391402.056128:0:13724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.056137:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e10a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e10ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391402.056156:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391402.056173:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391402.056194:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186420736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391402.056205:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169557376 00000100:00100000:0.0:1790391402.056215:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169557376 00010000:00010000:0.0:1790391402.056252:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e1091 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00a5 expref: 13 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391402.056263:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391402.056291:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169557504 00000100:00100000:0.0:1790391402.056294:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169557504 00010000:00010000:0.0:1790391402.056322:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e108a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b009e expref: 14 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391402.056337:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186420736 00000100:00100000:1.0:1790391402.056343:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186420736 00000100:00100000:0.0:1790391402.056344:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 49 00000100:00100000:0.0:1790391402.056358:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6dba3-950e-4d6c-8a57-84db940a8db9+14:2384:x1877361169557376:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391402.056366:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5280030400/0x2b1b7949f13e10ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e10a6 expref: 21 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391402.056372:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186420608 00010000:00010000:0.0:1790391402.056375:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790391402.056380:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186420608 00010000:00010000:0.0:1790391402.056389:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e1091 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00a5 expref: 14 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391402.056402:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 50 00010000:00010000:0.0:1790391402.056404:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e1091 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00a5 expref: 14 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391402.056415:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6dba3-950e-4d6c-8a57-84db940a8db9+14:2383:x1877361169557504:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391402.056427:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391402.056428:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391402.056430:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391402.056442:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186420608:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1790391402.056443:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e108a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b009e expref: 14 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.056459:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e108a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b009e expref: 14 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.056471:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:2.0:1790391402.056477:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00000100:00100000:0.0:1790391402.056482:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6dba3-950e-4d6c-8a57-84db940a8db9+14:2384:x1877361169557376:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 127us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391402.056490:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 49 00000100:00100000:1.0:1790391402.056496:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6dba3-950e-4d6c-8a57-84db940a8db9+14:2383:x1877361169557504:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391402.056504:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 50 00000100:00100000:0.0:1790391402.056516:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00002000:00010000:2.0:1790391402.056520:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6ab73465, atime: 0x6ab73465, ctime: 0x6ab73465, blocks: 0x0 00000100:00100000:0.0:1790391402.056525:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:3640:x1877361186420736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391402.056528:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1204 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.056532:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391402.056535:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391402.056536:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391402.056541:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391402.056543:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5280030400/0x2b1b7949f13e10ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e10a6 expref: 21 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.056556:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5280030400/0x2b1b7949f13e10ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e10a6 expref: 21 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.056562:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:2.0:1790391402.056568:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391402.056569:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280030400/0x2b1b7949f13e10ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e10a6 expref: 21 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.056576:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.056583:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.056591:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.056597:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.056607:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.056607:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.056619:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.056624:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.056631:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.056638:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391402.056638:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.056644:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309de00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391402.056649:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.056658:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391402.056667:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.056673:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391402.056676:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391402.056681:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.056691:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391402.056696:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.056705:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1204 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391402.056717:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:3640:x1877361186420736:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (457us total) trans 0 rc 0/0 00010000:00010000:1.0:1790391402.056721:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1204 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391402.056726:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1790391402.056736:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1204 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391402.056767:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391402.056769:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391402.056771:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391402.056775:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186420736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391402.056848:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186420608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 411us (8134us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790391402.056855:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1790391402.056875:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790391402.056933:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e1091 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00a5 expref: 12 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391402.056943:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186419968:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391402.056953:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e108a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b009e expref: 11 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391402.056975:0:13722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13722:1877361186420096:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391402.057004:0:13722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.057013:0:13722:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.057020:0:13722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391402.057025:0:13722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309de00/0x2b1b7949f13e11fd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790391402.059003:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e51832a7480/2, rc 0, transno 4294967301 00000100:00100000:0.0:1790391402.059022:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186420608:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1790391402.450366:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391403.017166:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391403.017350:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186420992:0@lo:400:kworker.0 00000100:00100000:0.0:1790391403.017445:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.017531:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391403.017538:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186421120:0@lo:400:kworker.0 00000100:00100000:0.0:1790391403.017570:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.017609:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186420992 00000100:00100000:0.0:1790391403.017620:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186420992 00000100:00100000:0.0:1790391403.017678:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1790391403.017689:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186420992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391403.017749:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186420992:12345-0@lo:400:kworker.0 Request processed in 61us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.017757:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1790391403.017797:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186421120 00000100:00100000:0.0:1790391403.017801:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186421120 00000100:00100000:0.0:1790391403.017827:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790391403.017833:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186421120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391403.017869:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186421120:12345-0@lo:400:kworker.0 Request processed in 35us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.017904:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790391403.017950:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186421120:0@lo:400:kworker.0 00000100:00100000:0.0:1790391403.017963:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186420992:0@lo:400:kworker.0 00000020:00000080:2.0:1790391403.021043:0:13773:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcee1b0ba0 20000000:00000080:2.0:1790391403.021073:0:13773:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e518387fc00 uarg=0000000000000000 20000000:01000000:2.0:1790391403.021153:0:13773:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1790391403.021163:0:13773:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1790391403.021169:0:13773:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000100:00100000:1.0:1790391403.021556:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186421248:0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.021661:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.021785:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b5d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186420864:0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.021820:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.021898:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186420864 00000100:00100000:1.0:1790391403.021908:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186420864 00000100:00100000:1.0:1790391403.021974:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1790391403.021985:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:3639:x1877361186420864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.022053:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:3639:x1877361186420864:12345-0@lo:400:kworker.0 Request processed in 69us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.022061:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1790391403.022128:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b5d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186420864:0@lo:400:kworker.0 00000100:00100000:3.0:1790391403.022546:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186421632:0@lo:400:kworker.0 00000100:00100000:3.0:1790391403.022591:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.022642:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186421760:0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.022674:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.022700:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186422272:0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.022723:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.022745:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790391403.022751:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186421376:0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.022790:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.022825:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186421888:0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.022847:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.022866:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186422400:0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.022905:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.022937:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186421760 00000100:00100000:1.0:1790391403.022944:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186421760 00000100:00100000:1.0:1790391403.022998:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186422272 00000100:00100000:1.0:1790391403.023001:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186422272 00000100:00100000:1.0:1790391403.023016:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186421888 00000100:00100000:1.0:1790391403.023019:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186421888 00000100:00100000:1.0:1790391403.023029:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186422400 00000100:00100000:1.0:1790391403.023031:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186422400 00000100:00100000:1.0:1790391403.023046:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790391403.023054:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186421760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.023098:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186421760:12345-0@lo:400:kworker.0 Request processed in 45us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.023105:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790391403.023121:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391403.023129:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186422272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.023159:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186422272:12345-0@lo:400:kworker.0 Request processed in 32us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.023165:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391403.023174:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790391403.023179:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186421888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.023202:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186421888:12345-0@lo:400:kworker.0 Request processed in 23us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.023207:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790391403.023224:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391403.023230:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186422400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.023255:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186422400:12345-0@lo:400:kworker.0 Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.023260:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391403.023297:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186421376 00000100:00100000:1.0:1790391403.023302:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186421376 00000100:00100000:1.0:1790391403.023332:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790391403.023339:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186421376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.023371:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186421376:12345-0@lo:400:kworker.0 Request processed in 32us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.023377:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1790391403.023403:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391403.023409:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391403.023441:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186421376:0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.023454:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186421888:0@lo:400:kworker.0 00010000:00080000:1.0:1790391403.023467:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183a43800 x1877361186422400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391403.023478:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186422400:0@lo:400:kworker.0 00000100:00100000:1.0:1790391403.023489:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186421760:0@lo:400:kworker.0 00010000:00080000:1.0:1790391403.023498:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183a41500 x1877361186422272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391403.023506:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186422272:0@lo:400:kworker.0 00000100:00100000:2.0:1790391403.023940:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186421504:0@lo:400:kworker.0 00000100:00100000:3.0:1790391403.024307:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186422144:0@lo:400:kworker.0 00000100:00100000:3.0:1790391403.024338:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1790391403.024527:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1790391403.024596:0:13773:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1790391403.024725:0:13773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1790391403.024751:0:13773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1790391403.024763:0:13773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1790391403.024787:0:13773:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790391403.024812:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.024850:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.024863:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.024871:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.024901:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.024910:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.024916:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391403.024921:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.024930:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.024945:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.024953:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.024959:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e120b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391403.026149:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186421248 00000100:00100000:0.0:1790391403.026163:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186421248 00000100:00100000:3.0:1790391403.026540:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391403.026581:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186422016:0@lo:400:kworker.0 00000100:00100000:3.0:1790391403.026650:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391403.026736:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186421632 00000100:00100000:2.0:1790391403.026742:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186421632 00000100:00100000:2.0:1790391403.026816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186422144 00000100:00100000:2.0:1790391403.026820:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186422144 00000100:00100000:2.0:1790391403.026835:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186421504 00000100:00100000:2.0:1790391403.026838:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186421504 00000100:00100000:2.0:1790391403.026849:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186422016 00000100:00100000:2.0:1790391403.026851:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186422016 00000100:00100000:2.0:1790391403.026868:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1790391403.027002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186421632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391403.027074:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186421632:12345-0@lo:400:kworker.0 Request processed in 197us (4482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.027082:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1790391403.027102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1790391403.027108:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186422144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391403.027138:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186422144:12345-0@lo:400:kworker.0 Request processed in 30us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.027145:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1790391403.027156:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1790391403.027161:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186421504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391403.027191:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186421504:12345-0@lo:400:kworker.0 Request processed in 30us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.027197:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1790391403.027208:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1790391403.027214:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186422016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391403.027241:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186422016:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.027258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:3.0:1790391403.027510:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391403.027516:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391403.027557:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186421504:0@lo:400:kworker.0 00000100:00100000:3.0:1790391403.027574:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186422016:0@lo:400:kworker.0 00010000:00080000:3.0:1790391403.027619:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183a43100 x1877361186421632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391403.027631:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186421632:0@lo:400:kworker.0 00010000:00080000:3.0:1790391403.027645:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183a40a80 x1877361186422144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391403.027653:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186422144:0@lo:400:kworker.0 00000100:00100000:0.0:1790391403.030684:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1790391403.030703:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186421248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391403.030991:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186421248:12345-0@lo:400:kworker.0 Request processed in 292us (9328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.031000:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1790391403.031094:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186421248:0@lo:400:kworker.0 10000000:01000000:0.0:1790391403.464088:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391403.464108:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52bf9b4000 from 7 10000000:01000000:0.0:1790391403.464115:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391403.464197:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391403.464221:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391403.464235:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391403.464270:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186422528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.464397:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.464472:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221a900 going to sleep for 11 seconds 00000100:00100000:1.0:1790391403.465119:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186422528 00000100:00100000:1.0:1790391403.465154:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186422528 00000100:00100000:1.0:1790391403.465434:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1790391403.465447:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:6509:x1877361186422528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391403.465468:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391403.465492:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5183086a00/0x2b1b7949f13e1219 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e1212 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.465530:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183086a00/0x2b1b7949f13e1219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e1212 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.465545:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5183086a00/0x2b1b7949f13e1219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e1212 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.465556:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086a00, rc 0) 00000100:00100000:1.0:1790391403.465643:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186422528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.465651:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00010000:00010000:3.0:1790391403.467499:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391403.468389:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186422528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391403.468427:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391403.468441:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391403.468572:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186422656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.468652:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.468715:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221a900 going to sleep for 11 seconds 00000100:00100000:1.0:1790391403.469607:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186422656 00000100:00100000:1.0:1790391403.469619:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186422656 00000100:00100000:1.0:1790391403.469698:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1790391403.469710:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186422656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.469967:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186422656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.469976:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1790391403.470913:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186422656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.471087:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186422784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.472530:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.472661:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221a900 going to sleep for 11 seconds 00000100:00100000:2.0:1790391403.477078:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186422784 00000100:00100000:2.0:1790391403.477652:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186422784 00000100:00100000:2.0:1790391403.477771:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1790391403.477786:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186422784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391403.480443:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186422784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2647us (7902us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.480460:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1790391403.480841:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186422784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391403.482671:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13786:1877361186422912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391403.482791:0:13786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391403.482847:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967ae000 going to sleep for 11 seconds 00000100:00100000:1.0:1790391403.482921:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186422912 00000100:00100000:1.0:1790391403.482931:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186422912 00000100:00100000:1.0:1790391403.483114:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1790391403.483127:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:13786:x1877361186422912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391403.483329:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:13786:x1877361186422912:12345-0@lo:502:llog_process_th.0 Request processed in 204us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.483338:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1790391403.483453:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13786:1877361186422912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391403.483485:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391403.483498:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391403.483500:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790391403.483507:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52bf9b4000 00000020:00000080:3.0:1790391403.483511:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391403.483595:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391403.483599:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391403.483601:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790391403.483604:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391403.483606:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391403.483608:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790391403.483611:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52bf9b4000 00000020:00000080:3.0:1790391403.483614:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790391403.483657:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13786:1877361186423040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391403.483705:0:13786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391403.488120:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391403.488316:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186423040 00000100:00100000:2.0:1790391403.488331:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186423040 00000100:00100000:2.0:1790391403.488405:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1790391403.488418:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:13786:x1877361186423040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391403.488646:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:13786:x1877361186423040:12345-0@lo:502:llog_process_th.0 Request processed in 230us (4938us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.488655:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1790391403.489074:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13786:1877361186423040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391403.489173:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391403.489184:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391403.489187:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790391403.489192:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790391403.489517:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790391403.489548:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391403.489563:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.489578:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391403.489592:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790391403.489596:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b77e2800 from 7 10000000:01000000:1.0:1790391403.489600:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391403.489649:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.489660:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.489671:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391403.502723:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186423168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.502842:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.502931:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51838986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391403.503006:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186423168 00000100:00100000:0.0:1790391403.503023:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186423168 00000100:00100000:0.0:1790391403.503106:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1790391403.503119:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:6509:x1877361186423168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391403.503139:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391403.503161:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eeec00/0x2b1b7949f13e1227 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e1220 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391403.503192:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eeec00/0x2b1b7949f13e1227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e1220 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391403.503204:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eeec00/0x2b1b7949f13e1227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e1220 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391403.503213:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eeec00, rc 0) 00000100:00100000:0.0:1790391403.503311:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186423168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.503318:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1790391403.503393:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186423168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391403.503421:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.503446:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391403.503563:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186423296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.503603:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.503639:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51838986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391403.503811:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186423296 00000100:00100000:3.0:1790391403.503819:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186423296 00000100:00100000:3.0:1790391403.503868:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1790391403.504111:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186423296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391403.504279:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186423296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391403.504309:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1790391403.504472:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186423296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.504513:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186423424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.504562:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.504597:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51838986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391403.504625:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186423424 00000100:00100000:0.0:1790391403.504636:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186423424 00000100:00100000:0.0:1790391403.504701:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1790391403.504711:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186423424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.505031:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186423424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 320us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.505048:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1790391403.505104:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186423424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.506457:0:13789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13789:1877361186423552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391403.506541:0:13789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.506590:0:13789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183898cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391403.506651:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186423552 00000100:00100000:3.0:1790391403.506659:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186423552 00000100:00100000:3.0:1790391403.506714:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1790391403.506724:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:13789:x1877361186423552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391403.506868:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:13789:x1877361186423552:12345-0@lo:502:llog_process_th.0 Request processed in 144us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.506952:0:13789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13789:1877361186423552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391403.507004:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391403.507021:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391403.507025:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391403.507036:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52b77e2800 00000020:00000080:0.0:1790391403.507039:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391403.507106:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391403.507110:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391403.507112:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391403.507115:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391403.507118:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391403.507119:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790391403.507123:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52b77e2800 00000020:00000080:0.0:1790391403.507125:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790391403.507175:0:13789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13789:1877361186423680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391403.507250:0:13789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.507319:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186423680 00000100:00100000:0.0:1790391403.507325:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186423680 00000100:00100000:3.0:1790391403.507955:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1790391403.510847:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1790391403.510867:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:13789:x1877361186423680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391403.511061:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:13789:x1877361186423680:12345-0@lo:502:llog_process_th.0 Request processed in 202us (3810us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.511068:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1790391403.511130:0:13789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391403.511153:0:13789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13789:1877361186423680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391403.511186:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391403.511199:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391403.511202:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790391403.511211:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790391403.512546:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790391403.512592:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391403.512610:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.512625:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391403.512653:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790391403.512657:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b5eaa800 from 7 10000000:01000000:1.0:1790391403.512661:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391403.512719:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.512730:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.512742:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391403.512773:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186423808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.512861:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.512954:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52aff229c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391403.513201:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186423808 00000100:00100000:3.0:1790391403.513211:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186423808 00000100:00100000:3.0:1790391403.513263:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1790391403.513272:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:6509:x1877361186423808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391403.513297:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391403.513313:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b763cc00/0x2b1b7949f13e1235 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e122e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391403.513343:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b763cc00/0x2b1b7949f13e1235 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e122e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391403.513356:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b763cc00/0x2b1b7949f13e1235 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e122e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391403.513366:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763cc00, rc 0) 00000100:00100000:3.0:1790391403.513448:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186423808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391403.513456:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1790391403.513721:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186423808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391403.513743:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391403.513755:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391403.513843:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186423936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.513978:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.514184:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1790391403.514450:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186423936 00000100:00100000:1.0:1790391403.514457:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186423936 00000100:00100000:1.0:1790391403.514495:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1790391403.514504:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186423936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.514656:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186423936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.514664:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1790391403.514737:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186423936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.514777:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186424064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.514834:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.514990:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1790391403.515196:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186424064 00000100:00100000:1.0:1790391403.515201:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186424064 00000100:00100000:1.0:1790391403.515238:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1790391403.515246:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186424064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.515356:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186424064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.515363:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1790391403.517515:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186424064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.524919:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13790:1877361186424192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391403.525062:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.525417:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186424192 00000100:00100000:1.0:1790391403.525429:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186424192 00000100:00100000:1.0:1790391403.525510:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1790391403.525522:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:13790:x1877361186424192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391403.525688:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:13790:x1877361186424192:12345-0@lo:502:llog_process_th.0 Request processed in 168us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.525697:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1790391403.525924:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391403.525955:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13790:1877361186424192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391403.526005:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391403.526017:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391403.526021:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391403.526035:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52b5eaa800 00000020:00000080:0.0:1790391403.526045:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391403.526275:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391403.526281:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391403.526293:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391403.526298:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391403.526301:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391403.526303:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790391403.526307:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52b5eaa800 00000020:00000080:0.0:1790391403.526310:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790391403.526364:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13790:1877361186424320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391403.526418:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.526443:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391403.526539:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186424320 00000100:00100000:1.0:1790391403.526546:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186424320 00000100:00100000:1.0:1790391403.526591:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1790391403.526599:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:13790:x1877361186424320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391403.526700:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:13790:x1877361186424320:12345-0@lo:502:llog_process_th.0 Request processed in 101us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.526707:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1790391403.531133:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186424448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391403.531237:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.531715:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186424448 00000100:00100000:0.0:1790391403.531727:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186424448 00000100:00100000:0.0:1790391403.531809:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790391403.531821:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186424448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391403.531868:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391403.532839:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186424448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1011us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.532850:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:0.0:1790391403.533698:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b77eb100 x1877361186424448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391403.533733:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186424448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391403.533811:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13790:1877361186424320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790391403.533863:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391403.533951:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391403.533955:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790391403.533971:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790391403.535686:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790391403.535721:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391403.535735:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.535749:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391403.535762:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790391403.535766:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5289da8000 from 7 10000000:01000000:1.0:1790391403.535768:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391403.535821:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.535830:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.535862:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391403.537153:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186424576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.537263:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.537336:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391403.537691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186424576 00000100:00100000:2.0:1790391403.537705:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186424576 00000100:00100000:2.0:1790391403.537779:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1790391403.537791:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:6509:x1877361186424576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391403.537811:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391403.537833:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e1243 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e123c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.537917:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e1243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e123c expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.537931:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e1243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e123c expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.537943:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d400, rc 0) 00000100:00100000:2.0:1790391403.537999:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186424576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.538007:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1790391403.538846:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186424576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391403.538905:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391403.538919:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391403.539056:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186424704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.539131:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.539516:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391403.540725:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186424704 00000100:00100000:2.0:1790391403.540744:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186424704 00000100:00100000:2.0:1790391403.540820:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1790391403.540833:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186424704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391403.541574:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186424704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 740us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.541585:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000040:00080000:0.0:1790391403.542656:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790391403.543491:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186424704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.543578:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186424832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.543675:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391403.543722:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52aff22480 going to sleep for 11 seconds 00000100:00100000:1.0:1790391403.543747:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186424832 00000100:00100000:1.0:1790391403.543755:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186424832 00000100:00100000:1.0:1790391403.543812:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1790391403.543823:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186424832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391403.543997:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:6509:x1877361186424832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.544006:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1790391403.544061:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:6509:1877361186424832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.546550:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b77eb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13792:1877361186424960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790391403.546669:0:13792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391403.547326:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518221a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391403.548466:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391403.548497:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186425088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391403.548579:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391403.548636:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186425088 00000100:00100000:2.0:1790391403.548647:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186425088 00000100:00100000:2.0:1790391403.548711:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790391403.548723:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186425088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391403.548753:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391403.548805:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186425088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.548829:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1790391403.548912:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183a40a80 x1877361186425088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391403.548937:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186425088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391403.551317:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186424960 00000100:00100000:1.0:1790391403.551343:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186424960 00000100:00100000:1.0:1790391403.551477:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1790391403.551490:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:13792:x1877361186424960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391403.551732:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:13792:x1877361186424960:12345-0@lo:502:llog_process_th.0 Request processed in 244us (5063us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.551741:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1790391403.551867:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b77eb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13792:1877361186424960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391403.551949:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391403.551971:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391403.551975:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790391403.551993:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5289da8000 00000020:00000080:3.0:1790391403.551996:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391403.552065:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391403.552068:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391403.552070:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790391403.552073:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391403.552075:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391403.552087:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790391403.552091:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5289da8000 00000020:00000080:3.0:1790391403.552094:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790391403.552157:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13792:1877361186425216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391403.552220:0:13792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391403.555832:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391403.560521:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186425216 00000100:00100000:2.0:1790391403.560545:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186425216 00000100:00100000:2.0:1790391403.560621:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1790391403.560633:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:13792:x1877361186425216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391403.560894:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:13792:x1877361186425216:12345-0@lo:502:llog_process_th.0 Request processed in 246us (8656us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.560903:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1790391403.561246:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:13792:1877361186425216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790391403.561303:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391403.561313:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391403.561316:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790391403.561321:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790391403.561637:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1790391403.561663:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391403.561686:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391403.561699:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790391403.581436:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790391403.783058:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391403.783414:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169557632 00000100:00100000:2.0:1790391403.783428:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169557632 00000100:00100000:2.0:1790391403.783487:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 359 00000100:00100000:2.0:1790391403.783496:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:6159:x1877361169557632:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391403.783516:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391403.783539:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e124a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00f2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.783572:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e124a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00f2 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.783604:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e124a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00f2 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.783617:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d600, rc 0) 00000100:00100000:2.0:1790391403.784448:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169557632:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 Request processed in 943us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.784458:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 359 00000100:00100000:3.0:1790391403.792299:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391403.792450:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169557760 00000100:00100000:0.0:1790391403.792463:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169557760 00000100:00100000:0.0:1790391403.792614:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 360 00000100:00100000:0.0:1790391403.792626:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169557760:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.793551:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169557760:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 Request processed in 235us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.793597:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 360 00000100:00100000:3.0:1790391403.797722:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391403.798537:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169557888 00000100:00100000:0.0:1790391403.798555:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169557888 00000100:00100000:0.0:1790391403.798639:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 361 00000100:00100000:0.0:1790391403.798652:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169557888:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.800330:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169557888:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 Request processed in 1663us (2606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.800346:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 361 00000100:00100000:3.0:1790391403.810158:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391403.814801:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169558016 00000100:00100000:0.0:1790391403.814822:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169558016 00000100:00100000:0.0:1790391403.814945:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 362 00000100:00100000:0.0:1790391403.814959:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:10770:x1877361169558016:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391403.815264:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:10770:x1877361169558016:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 308us (5120us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.815273:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 362 00000100:00100000:1.0:1790391403.826998:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391403.831072:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169558144 00000100:00100000:0.0:1790391403.831095:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169558144 00000100:00100000:0.0:1790391403.831199:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 363 00000100:00100000:0.0:1790391403.831213:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:10770:x1877361169558144:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391403.831451:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:10770:x1877361169558144:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 241us (4468us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.831459:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 363 00000100:00100000:3.0:1790391403.848672:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391403.848769:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169558272 00000100:00100000:2.0:1790391403.848784:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169558272 00000100:00100000:2.0:1790391403.848865:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 364 00000100:00100000:2.0:1790391403.849003:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:6159:x1877361169558272:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391403.849027:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391403.849053:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309c400/0x2b1b7949f13e1251 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b00f9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.849097:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309c400/0x2b1b7949f13e1251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00f9 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.849310:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309c400/0x2b1b7949f13e1251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00f9 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391403.849323:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c400, rc 0) 00000100:00100000:2.0:1790391403.849417:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:6159:x1877361169558272:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 Request processed in 541us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.849434:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 364 00000100:00100000:3.0:1790391403.851601:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391403.852227:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169558400 00000100:00100000:0.0:1790391403.852242:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169558400 00000100:00100000:0.0:1790391403.852350:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 365 00000100:00100000:0.0:1790391403.852362:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:6159:x1877361169558400:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.852586:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:6159:x1877361169558400:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 Request processed in 226us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.852596:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 365 00000100:00100000:1.0:1790391403.868768:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391403.869050:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169558528 00000100:00100000:0.0:1790391403.869064:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169558528 00000100:00100000:0.0:1790391403.869136:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 366 00000100:00100000:0.0:1790391403.869148:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:6159:x1877361169558528:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391403.869381:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:6159:x1877361169558528:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 Request processed in 234us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391403.869391:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 366 00000100:00100000:3.0:1790391403.877695:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391403.877950:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169558656 00000100:00100000:2.0:1790391403.878109:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169558656 00000100:00100000:2.0:1790391403.878180:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 367 00000100:00100000:2.0:1790391403.878192:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:10774:x1877361169558656:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391403.878424:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:10774:x1877361169558656:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 231us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391403.878433:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 367 00000100:00100000:3.0:1790391403.887632:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391403.887817:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169558784 00000100:00100000:1.0:1790391403.887831:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169558784 00000100:00100000:1.0:1790391403.888135:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 368 00000100:00100000:1.0:1790391403.888151:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:10774:x1877361169558784:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391403.888547:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:10774:x1877361169558784:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 398us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391403.888556:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 368 00000100:00100000:3.0:1790391404.423431:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391404.423486:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391404.423531:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391404.423610:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391404.423641:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391404.423694:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391404.423789:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169559168 00000100:00100000:0.0:1790391404.423804:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169559168 00000100:00100000:0.0:1790391404.423955:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169559424 00000100:00100000:0.0:1790391404.423960:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169559424 00000100:00100000:0.0:1790391404.423979:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169559040 00000100:00100000:0.0:1790391404.423982:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169559040 00000100:00100000:0.0:1790391404.423997:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169559552 00000100:00100000:0.0:1790391404.424000:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169559552 00000100:00100000:0.0:1790391404.424019:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 219 00000100:00100000:0.0:1790391404.424032:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169559168:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391404.424140:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169559168:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 110us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391404.424163:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 219 00000100:00100000:0.0:1790391404.424185:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 220 00000100:00100000:0.0:1790391404.424193:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169559424:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391404.424240:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169559424:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 47us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391404.424247:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 220 00000100:00100000:0.0:1790391404.424260:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 221 00000100:00100000:0.0:1790391404.424267:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169559040:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391404.424308:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169559040:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 41us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391404.424314:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 221 00000100:00100000:0.0:1790391404.424326:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 222 00000100:00100000:0.0:1790391404.424333:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169559552:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391404.424357:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169559552:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 25us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391404.424362:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 222 00000100:00100000:0.0:1790391404.424419:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169558912 00000100:00100000:0.0:1790391404.424424:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169558912 00000100:00100000:0.0:1790391404.424451:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 369 00000100:00100000:0.0:1790391404.424457:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2381:x1877361169558912:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391404.424483:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2381:x1877361169558912:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 27us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391404.424490:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 369 00000100:00100000:1.0:1790391404.427594:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169559296 00000100:00100000:1.0:1790391404.427618:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169559296 00000100:00100000:1.0:1790391404.428098:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 105 00000100:00100000:1.0:1790391404.428114:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169559296:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391404.428219:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169559296:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 109us (4575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391404.428227:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 105 00000100:00080000:3.0:1790391404.428322:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391404.428328:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391404.428331:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1790391404.488179:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391404.552358:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186425344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391404.552467:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391404.552566:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391404.552575:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186425472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391404.552582:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186425344 00000100:00100000:3.0:1790391404.552605:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186425344 00000100:00100000:0.0:1790391404.552632:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391404.552671:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186425472 00000100:00100000:0.0:1790391404.552675:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186425472 00000100:00100000:3.0:1790391404.552680:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790391404.552693:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186425344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391404.552744:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391404.552801:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790391404.552811:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186425344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391404.552812:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186425472:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391404.552826:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000004:00000024:0.0:1790391404.552851:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790391404.553084:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186425600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391404.553117:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391404.553158:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186425600 00000100:00100000:3.0:1790391404.553163:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186425600 00000100:00100000:3.0:1790391404.553201:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790391404.553209:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186425600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391404.553221:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391404.553254:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186425600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391404.553260:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1790391404.553287:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391404.553294:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186425344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391404.553317:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186425600:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1790391404.553537:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790391404.553817:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186425472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1005us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391404.553826:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790391404.556460:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186425472:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1790391404.618384:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391405.512823:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391406.536188:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391406.600265:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391406.600299:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186425728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391406.600408:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391406.600710:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186425728 00000100:00100000:2.0:1790391406.600722:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186425728 00000100:00100000:2.0:1790391406.600793:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790391406.600804:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186425728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391406.600848:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790391406.600939:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186425728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391406.600947:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790391406.601247:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186425728:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790391407.560952:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790391407.630747:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1790391408.136526:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186426112:0@lo:400:kworker.0 00000100:00100000:2.0:1790391408.136609:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391408.136676:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186426624:0@lo:400:kworker.0 00000100:00100000:2.0:1790391408.136703:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391408.136728:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186427136:0@lo:400:kworker.0 00000100:00100000:2.0:1790391408.136748:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391408.136774:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790391408.136779:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186426240:0@lo:400:kworker.0 00000100:00100000:2.0:1790391408.136799:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391408.136816:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186426752:0@lo:400:kworker.0 00000100:00100000:2.0:1790391408.136851:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391408.136872:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186427264:0@lo:400:kworker.0 00000100:00100000:2.0:1790391408.136921:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391408.136951:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186426624 00000100:00100000:2.0:1790391408.136958:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186426624 00000100:00100000:2.0:1790391408.137008:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186427136 00000100:00100000:2.0:1790391408.137012:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186427136 00000100:00100000:2.0:1790391408.137024:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186426240 00000100:00100000:2.0:1790391408.137027:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186426240 00000100:00100000:2.0:1790391408.137040:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1790391408.137048:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186426624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391408.137103:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186426624:12345-0@lo:400:kworker.0 Request processed in 55us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391408.137109:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1790391408.137124:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790391408.137129:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186427136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391408.137157:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186427136:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391408.137163:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790391408.137172:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790391408.137177:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186426240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391408.137203:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186426240:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391408.137208:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790391408.137261:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186426240:0@lo:400:kworker.0 00010000:00080000:2.0:1790391408.137277:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183a40a80 x1877361186426624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391408.137294:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186426624:0@lo:400:kworker.0 00010000:00080000:2.0:1790391408.137306:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76fdf80 x1877361186427136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391408.137313:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186427136:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.137445:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186425984:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.137478:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391408.137509:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186426496:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.137532:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391408.137555:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186427008:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.137576:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391408.137608:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1790391408.137614:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186425856:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.137642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391408.137663:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186426368:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.137688:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391408.137708:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186426880:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.137729:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391408.137744:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186427392:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.137763:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391408.137793:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186426112 00000100:00100000:0.0:1790391408.137796:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186426112 00000100:00100000:0.0:1790391408.137821:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186426368 00000100:00100000:0.0:1790391408.137824:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186426368 00000100:00100000:0.0:1790391408.137837:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790391408.137843:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186426112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.137903:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186426112:12345-0@lo:400:kworker.0 Request processed in 60us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391408.137910:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790391408.137923:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790391408.137929:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186426368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.137960:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186426368:12345-0@lo:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391408.137966:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790391408.137994:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186425984 00000100:00100000:0.0:1790391408.137998:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186425984 00000100:00100000:0.0:1790391408.138014:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186426496 00000100:00100000:0.0:1790391408.138016:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186426496 00000100:00100000:0.0:1790391408.138027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186427008 00000100:00100000:0.0:1790391408.138029:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186427008 00000100:00100000:0.0:1790391408.138044:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790391408.138050:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186425984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.138081:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186425984:12345-0@lo:400:kworker.0 Request processed in 31us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391408.138086:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790391408.138098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790391408.138103:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186426496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.138128:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186426496:12345-0@lo:400:kworker.0 Request processed in 25us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391408.138140:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790391408.138152:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1790391408.138158:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186427008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.138184:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186427008:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391408.138189:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1790391408.138216:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186426368:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.138224:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186425984:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.138232:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186426496:0@lo:400:kworker.0 00000100:00100000:0.0:1790391408.138251:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186427008:0@lo:400:kworker.0 00000100:00080000:3.0:1790391408.138380:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391408.138385:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391408.138493:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186426752 00000100:00100000:1.0:1790391408.138498:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186426752 00000100:00100000:1.0:1790391408.138539:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186427264 00000100:00100000:1.0:1790391408.138542:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186427264 00000100:00100000:1.0:1790391408.138555:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186426880 00000100:00100000:1.0:1790391408.138557:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186426880 00000100:00100000:1.0:1790391408.138568:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186427392 00000100:00100000:1.0:1790391408.138571:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186427392 00000100:00100000:1.0:1790391408.138585:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790391408.138591:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186426752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391408.138642:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186426752:12345-0@lo:400:kworker.0 Request processed in 51us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391408.138648:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790391408.138662:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790391408.138668:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186427264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391408.138697:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186427264:12345-0@lo:400:kworker.0 Request processed in 29us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391408.138703:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790391408.138714:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790391408.138719:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186426880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391408.138751:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186426880:12345-0@lo:400:kworker.0 Request processed in 32us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391408.138757:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790391408.138768:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790391408.138774:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186427392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391408.138799:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186427392:12345-0@lo:400:kworker.0 Request processed in 26us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391408.138812:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790391408.138860:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1790391408.138865:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e51832a7480, transno 4294967301 00000100:00100000:1.0:1790391408.138893:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186426880:0@lo:400:kworker.0 00010000:00080000:1.0:1790391408.138909:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76ff100 x1877361186427392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391408.138918:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186427392:0@lo:400:kworker.0 00000100:00100000:1.0:1790391408.138944:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186425856 00000100:00100000:1.0:1790391408.138948:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186425856 00000100:00100000:1.0:1790391408.138975:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1790391408.138981:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186425856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391408.139016:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186425856:12345-0@lo:400:kworker.0 Request processed in 34us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391408.139021:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1790391408.139057:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186425856:0@lo:400:kworker.0 00000100:00080000:3.0:1790391408.139163:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391408.139168:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391408.139963:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186426752:0@lo:400:kworker.0 00010000:00080000:2.0:1790391408.139980:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76fd880 x1877361186427264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391408.139990:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186427264:0@lo:400:kworker.0 00000100:00100000:2.0:1790391408.140001:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186426112:0@lo:400:kworker.0 00010000:00010000:1.0:1790391408.585496:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391408.648421:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186427520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391408.648492:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391408.648708:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186427520 00000100:00100000:0.0:1790391408.648717:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186427520 00000100:00100000:0.0:1790391408.648771:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790391408.648782:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186427520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391408.648811:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391408.648870:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186427520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391408.648906:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1790391408.648986:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51833c8380 x1877361186427520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391408.649004:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186427520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391408.649561:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391408.649572:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186427648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391408.649619:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391408.649730:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186427648 00000100:00100000:3.0:1790391408.649736:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186427648 00000100:00100000:3.0:1790391408.649771:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790391408.649780:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186427648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391408.649794:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391408.649840:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186427648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391408.649847:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1790391408.649930:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76fc380 x1877361186427648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391408.649945:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186427648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391409.547297:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391409.547473:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391409.547506:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391409.547537:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391409.547556:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391409.547577:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391409.547617:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169559936 00000100:00100000:3.0:1790391409.547626:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169559936 00000100:00100000:3.0:1790391409.547676:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169560192 00000100:00100000:3.0:1790391409.547679:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169560192 00000100:00100000:3.0:1790391409.547690:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169559808 00000100:00100000:3.0:1790391409.547692:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169559808 00000100:00100000:3.0:1790391409.547703:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169560320 00000100:00100000:3.0:1790391409.547706:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169560320 00000100:00100000:3.0:1790391409.547720:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 229 00000100:00100000:3.0:1790391409.547729:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169559936:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391409.547813:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169559936:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 85us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391409.547822:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 229 00000100:00100000:3.0:1790391409.547840:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 230 00000100:00100000:3.0:1790391409.547846:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169560192:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391409.547868:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169560192:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 23us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391409.547979:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 230 00000100:00100000:3.0:1790391409.547993:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 231 00000100:00100000:3.0:1790391409.548000:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169559808:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391409.548027:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169559808:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391409.548032:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 231 00000100:00100000:3.0:1790391409.548043:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 232 00000100:00100000:3.0:1790391409.548048:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169560320:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391409.548069:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169560320:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 21us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391409.548074:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 232 00000100:00080000:3.0:1790391409.548210:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391409.548214:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391409.548454:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169560064 00000100:00100000:1.0:1790391409.548460:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169560064 00000100:00100000:1.0:1790391409.548509:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 110 00000100:00100000:1.0:1790391409.548517:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169560064:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391409.548554:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169560064:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 38us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391409.548561:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 110 00000100:00080000:3.0:1790391409.548767:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391409.560610:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169559680 00000100:00100000:2.0:1790391409.560627:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169559680 00000100:00100000:2.0:1790391409.560698:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 371 00000100:00100000:2.0:1790391409.560707:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169559680:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391409.560838:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169559680:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 131us (13551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391409.560846:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 371 00010000:00010000:1.0:1790391409.608347:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391409.672319:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186427776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391409.672400:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391409.672531:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186427776 00000100:00100000:3.0:1790391409.672540:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186427776 00000100:00100000:3.0:1790391409.672592:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790391409.672602:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186427776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391409.672647:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790391409.672695:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186427776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391409.672703:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790391409.672788:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186427776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391409.672984:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186427904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391409.673017:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391409.673151:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186427904 00000100:00100000:0.0:1790391409.673157:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186427904 00000100:00100000:0.0:1790391409.673192:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790391409.673199:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186427904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391409.673244:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391409.673292:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186427904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391409.673305:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790391409.673372:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186427904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391409.673646:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391409.673655:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186428032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391409.673680:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391409.673786:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186428032 00000100:00100000:2.0:1790391409.673791:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186428032 00000100:00100000:2.0:1790391409.673823:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790391409.673829:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186428032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391409.673839:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391409.673904:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186428032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391409.673919:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790391409.674037:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186428032:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790391410.632145:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391411.656082:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391411.720328:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186428160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391411.720672:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391411.720915:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186428160 00000100:00100000:3.0:1790391411.720926:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186428160 00000100:00100000:3.0:1790391411.721026:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790391411.721037:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186428160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391411.721093:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790391411.721181:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186428160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391411.721188:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790391411.721314:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186428160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790391412.680843:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391413.256365:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186428544:0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.256438:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391413.256509:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186429056:0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.256534:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391413.256560:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186429568:0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.256580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391413.256605:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790391413.256610:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186428416:0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.256631:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391413.256650:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186428928:0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.256670:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391413.256704:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186429440:0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.256726:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391413.256752:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186429056 00000100:00100000:3.0:1790391413.256759:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186429056 00000100:00100000:3.0:1790391413.256821:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186429568 00000100:00100000:3.0:1790391413.256825:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186429568 00000100:00100000:3.0:1790391413.256841:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186428416 00000100:00100000:3.0:1790391413.256843:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186428416 00000100:00100000:3.0:1790391413.256852:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186428928 00000100:00100000:3.0:1790391413.256853:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186428928 00000100:00100000:3.0:1790391413.256863:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186429440 00000100:00100000:3.0:1790391413.256866:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186429440 00000100:00100000:3.0:1790391413.256918:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790391413.256926:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186429056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.256982:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186429056:12345-0@lo:400:kworker.0 Request processed in 56us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391413.256989:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790391413.257007:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790391413.257013:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186429568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.257041:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186429568:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391413.257046:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790391413.257056:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790391413.257061:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186428416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.257085:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186428416:12345-0@lo:400:kworker.0 Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391413.257090:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790391413.257099:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790391413.257112:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186428928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.257140:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186428928:12345-0@lo:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391413.257145:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790391413.257156:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790391413.257162:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186429440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.257186:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186429440:12345-0@lo:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391413.257203:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:3.0:1790391413.257224:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391413.257228:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391413.257264:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186428416:0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.257274:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186428928:0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.257282:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186429440:0@lo:400:kworker.0 00010000:00080000:3.0:1790391413.257293:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822e9f80 x1877361186429056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391413.257302:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186429056:0@lo:400:kworker.0 00010000:00080000:3.0:1790391413.257310:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822eb480 x1877361186429568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391413.257319:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186429568:0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.257601:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186428288:0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.257643:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391413.257684:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186428800:0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.257708:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391413.257724:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186429312:0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.257746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391413.257763:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186429824:0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.257781:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391413.257812:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790391413.257818:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5181cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186428672:0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.257840:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391413.257857:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186429184:0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.257923:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391413.257940:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186429696:0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.257960:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391413.257988:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186429312 00000100:00100000:2.0:1790391413.257993:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186429312 00000100:00100000:2.0:1790391413.258029:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186429824 00000100:00100000:2.0:1790391413.258032:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186429824 00000100:00100000:2.0:1790391413.258046:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186429184 00000100:00100000:2.0:1790391413.258048:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186429184 00000100:00100000:2.0:1790391413.258060:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186429696 00000100:00100000:2.0:1790391413.258063:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186429696 00000100:00100000:2.0:1790391413.258089:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790391413.258096:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186429312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.258135:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186429312:12345-0@lo:400:kworker.0 Request processed in 40us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391413.258142:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790391413.258155:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790391413.258161:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186429824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.258187:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186429824:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391413.258204:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790391413.258217:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790391413.258222:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186429184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.258249:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186429184:12345-0@lo:400:kworker.0 Request processed in 28us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391413.258255:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790391413.258265:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790391413.258271:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186429696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.258295:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186429696:12345-0@lo:400:kworker.0 Request processed in 24us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391413.258299:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1790391413.258317:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391413.258320:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391413.258339:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186429184:0@lo:400:kworker.0 00010000:00080000:2.0:1790391413.258348:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822e8000 x1877361186429696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391413.258370:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186429696:0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.258382:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186429312:0@lo:400:kworker.0 00010000:00080000:2.0:1790391413.258391:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822e8a80 x1877361186429824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391413.258399:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186429824:0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.258422:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186428672 00000100:00100000:2.0:1790391413.258426:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186428672 00000100:00100000:2.0:1790391413.258452:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1790391413.258458:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186428672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391413.258494:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186428672:12345-0@lo:400:kworker.0 Request processed in 36us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391413.258500:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1790391413.258525:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186428672:0@lo:400:kworker.0 00000100:00100000:1.0:1790391413.258757:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186428544 00000100:00100000:1.0:1790391413.258770:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186428544 00000100:00100000:1.0:1790391413.258811:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186428800 00000100:00100000:1.0:1790391413.258815:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186428800 00000100:00100000:1.0:1790391413.258829:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790391413.258835:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186428544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391413.258916:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186428544:12345-0@lo:400:kworker.0 Request processed in 81us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391413.258922:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790391413.258935:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790391413.258941:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186428800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391413.258977:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186428800:12345-0@lo:400:kworker.0 Request processed in 37us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391413.258983:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790391413.259016:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186428800:0@lo:400:kworker.0 00000100:00100000:1.0:1790391413.259042:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186428544:0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.261467:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186428288 00000100:00100000:3.0:1790391413.261483:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186428288 00000100:00100000:3.0:1790391413.261551:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1790391413.261560:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186428288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391413.261668:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186428288:12345-0@lo:400:kworker.0 Request processed in 109us (4024us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391413.261675:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1790391413.262396:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5181cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186428288:0@lo:400:kworker.0 00010000:00010000:1.0:1790391413.707355:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391413.773651:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186429952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391413.773724:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391413.773799:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186429952 00000100:00100000:1.0:1790391413.773806:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186429952 00000100:00100000:1.0:1790391413.773851:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391413.773860:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186429952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391413.774064:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391413.774109:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186429952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 249us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391413.774139:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1790391413.774741:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822e9500 x1877361186429952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391413.774760:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186429952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391413.774778:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391413.774786:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186430080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391413.774821:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391413.775110:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186430080 00000100:00100000:0.0:1790391413.775117:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186430080 00000100:00100000:0.0:1790391413.775154:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790391413.775162:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186430080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391413.775177:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391413.775227:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186430080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391413.775233:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1790391413.776542:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51833c9180 x1877361186430080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391413.776562:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186430080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391414.665934:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391414.665971:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391414.665996:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391414.666025:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391414.666045:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391414.666066:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391414.666097:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169560576 00000100:00100000:3.0:1790391414.666106:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169560576 00000100:00100000:3.0:1790391414.666154:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169561088 00000100:00100000:3.0:1790391414.666157:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169561088 00000100:00100000:3.0:1790391414.666170:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169560704 00000100:00100000:3.0:1790391414.666173:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169560704 00000100:00100000:3.0:1790391414.666195:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169560960 00000100:00100000:1.0:1790391414.666196:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169560448 00000100:00100000:3.0:1790391414.666198:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169560960 00000100:00100000:1.0:1790391414.666199:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169560448 00000100:00100000:3.0:1790391414.666212:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 239 00000100:00100000:3.0:1790391414.666221:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169560576:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391414.666226:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 373 00000100:00100000:1.0:1790391414.666232:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a758c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169560448:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391414.666308:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169560832 00000100:00100000:2.0:1790391414.666313:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169560832 00000100:00100000:1.0:1790391414.666392:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a758c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169560448:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 149us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391414.666393:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169560576:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 161us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391414.666401:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 239 00000100:00100000:1.0:1790391414.666401:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 373 00000100:00100000:3.0:1790391414.666419:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 240 00000100:00100000:3.0:1790391414.666424:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169561088:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391414.666449:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169561088:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00080000:1.0:1790391414.666451:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391414.666455:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 240 00000100:00080000:1.0:1790391414.666455:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391414.666457:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391414.666479:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 241 00000100:00100000:1.0:1790391414.666486:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169560704:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391414.666513:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169560704:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391414.666544:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 115 00000100:00100000:2.0:1790391414.666552:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169560832:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391414.666587:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169560832:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 36us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391414.666593:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 115 00000100:00100000:3.0:1790391414.666985:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 242 00000100:00100000:3.0:1790391414.666998:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169560960:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391414.667030:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169560960:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 35us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391414.667037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 242 00000100:00100000:1.0:1790391414.674698:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 241 00010000:00010000:1.0:1790391414.734382:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391414.792186:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186430208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391414.792254:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391414.792326:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186430208 00000100:00100000:1.0:1790391414.792333:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186430208 00000100:00100000:1.0:1790391414.792374:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391414.792393:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186430208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391414.792420:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391414.792458:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186430208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391414.792465:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790391414.792505:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186430208:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1790391414.792542:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790391414.792715:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391414.792724:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186430336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391414.792755:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391414.792829:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186430336 00000100:00100000:3.0:1790391414.792834:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186430336 00000100:00100000:3.0:1790391414.792870:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790391414.792908:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186430336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391414.792933:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790391414.792973:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186430336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391414.792979:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790391414.793010:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186430336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391414.793601:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391414.793614:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186430464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391414.793650:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391414.794754:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186430464 00000100:00100000:2.0:1790391414.794774:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186430464 00000100:00100000:2.0:1790391414.794822:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790391414.794832:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186430464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391414.794865:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391414.795326:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186430464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 494us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391414.795334:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790391414.795401:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186430464:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1790391414.857298:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790391415.758614:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391416.777052:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391416.840344:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391416.840368:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186430592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391416.840440:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391416.840560:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186430592 00000100:00100000:2.0:1790391416.840569:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186430592 00000100:00100000:2.0:1790391416.840624:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790391416.840634:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186430592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391416.840670:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790391416.840857:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186430592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 223us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391416.840864:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790391416.841204:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186430592:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790391417.801530:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391418.376222:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391418.381532:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186430848:0@lo:400:kworker.0 00000100:00100000:2.0:1790391418.381614:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391418.381685:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186430720:0@lo:400:kworker.0 00000100:00100000:2.0:1790391418.381713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391418.381962:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186430848 00000100:00100000:3.0:1790391418.381972:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186430848 00000100:00100000:3.0:1790391418.382139:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1790391418.382163:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186430848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.382371:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186430720 00000100:00100000:0.0:1790391418.382376:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186430720 00000100:00100000:0.0:1790391418.382416:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1790391418.382424:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186430720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391418.383343:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186430976:0@lo:400:kworker.0 00000100:00100000:2.0:1790391418.383410:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186431360:0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.384934:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186430720:12345-0@lo:400:kworker.0 Request processed in 2504us (3213us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391418.384946:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1790391418.385045:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186431232:0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.385080:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391418.385137:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186431744:0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.385175:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391418.385197:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186432256:0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.385510:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391418.385552:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186431232 00000100:00100000:0.0:1790391418.385559:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186431232 00000100:00100000:0.0:1790391418.385600:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790391418.385608:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186431232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.385660:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186431232:12345-0@lo:400:kworker.0 Request processed in 53us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391418.385667:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790391418.385687:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186431744 00000100:00100000:0.0:1790391418.385691:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186431744 00000100:00100000:0.0:1790391418.385955:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186432256 00000100:00100000:0.0:1790391418.385959:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186432256 00000100:00100000:0.0:1790391418.385988:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790391418.385995:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186431744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.386178:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186431744:12345-0@lo:400:kworker.0 Request processed in 112us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391418.386187:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790391418.386201:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790391418.386208:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186432256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.386533:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186432256:12345-0@lo:400:kworker.0 Request processed in 325us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391418.386539:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1790391418.386562:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391418.386566:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391418.386612:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186431232:0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.386626:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186431744:0@lo:400:kworker.0 00010000:00080000:0.0:1790391418.386638:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822e8380 x1877361186432256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391418.386648:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186432256:0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.386707:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186431104:0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.387056:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391418.387082:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186431616:0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.387125:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391418.387142:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186432128:0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.387174:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391418.387206:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186431616 00000100:00100000:0.0:1790391418.387222:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186431616 00000100:00100000:0.0:1790391418.387496:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186432128 00000100:00100000:0.0:1790391418.387500:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186432128 00000100:00100000:0.0:1790391418.387520:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790391418.387526:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186431616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.387567:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186431616:12345-0@lo:400:kworker.0 Request processed in 41us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391418.387573:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790391418.387586:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790391418.387592:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186432128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.387618:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186432128:12345-0@lo:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391418.387624:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1790391418.387650:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391418.387653:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391418.387678:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186431616:0@lo:400:kworker.0 00010000:00080000:0.0:1790391418.387689:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822e9f80 x1877361186432128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391418.387698:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186432128:0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.387902:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186431104 00000100:00100000:0.0:1790391418.387907:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186431104 00000100:00100000:0.0:1790391418.387942:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790391418.387950:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186431104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.387989:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186431104:12345-0@lo:400:kworker.0 Request processed in 41us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391418.387996:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790391418.388023:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186431104:0@lo:400:kworker.0 00000100:00100000:3.0:1790391418.389512:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186430848:12345-0@lo:400:kworker.0 Request processed in 7348us (7890us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391418.389523:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790391418.389735:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391418.389779:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186431488:0@lo:400:kworker.0 00000100:00100000:1.0:1790391418.389818:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391418.389845:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186432000:0@lo:400:kworker.0 00000100:00100000:1.0:1790391418.389868:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391418.389945:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186431488 00000100:00100000:1.0:1790391418.389952:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186431488 00000100:00100000:1.0:1790391418.389994:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186432000 00000100:00100000:1.0:1790391418.389997:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186432000 00000100:00100000:1.0:1790391418.390030:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790391418.390038:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186431488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391418.390086:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186431488:12345-0@lo:400:kworker.0 Request processed in 49us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391418.390092:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790391418.390118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790391418.390125:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186432000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391418.390162:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186432000:12345-0@lo:400:kworker.0 Request processed in 38us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391418.390169:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00010000:00080000:1.0:1790391418.390202:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822e8a80 x1877361186431488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391418.390228:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186431488:0@lo:400:kworker.0 00010000:00080000:1.0:1790391418.390566:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822eb480 x1877361186432000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391418.390576:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186432000:0@lo:400:kworker.0 00000100:00080000:1.0:1790391418.390604:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391418.393430:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186430976 00000100:00100000:3.0:1790391418.393459:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186430976 00000100:00100000:3.0:1790391418.393528:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790391418.393538:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186430976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391418.393638:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186430976:12345-0@lo:400:kworker.0 Request processed in 102us (3914us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391418.393645:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790391418.393695:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186430976:0@lo:400:kworker.0 00000100:00100000:2.0:1790391418.396906:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391418.397027:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186431872:0@lo:400:kworker.0 00000100:00100000:2.0:1790391418.397069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391418.404046:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186430848:0@lo:400:kworker.0 00000100:00100000:2.0:1790391418.404062:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186430720:0@lo:400:kworker.0 00000100:00100000:1.0:1790391418.405500:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186431360 00000100:00100000:1.0:1790391418.405513:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186431360 00000100:00100000:1.0:1790391418.405581:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186431872 00000100:00100000:1.0:1790391418.405584:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186431872 00000100:00100000:1.0:1790391418.405609:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790391418.405617:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186431360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391418.405700:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186431360:12345-0@lo:400:kworker.0 Request processed in 83us (8800us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391418.405706:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790391418.405721:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1790391418.405811:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391418.405939:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186431872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391418.405978:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186431872:12345-0@lo:400:kworker.0 Request processed in 114us (8909us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391418.405986:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1790391418.406139:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186431360:0@lo:400:kworker.0 00000100:00100000:2.0:1790391418.406161:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186431872:0@lo:400:kworker.0 00010000:00010000:1.0:1790391418.826431:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391418.888226:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186432384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391418.888296:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391418.888407:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186432384 00000100:00100000:3.0:1790391418.888415:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186432384 00000100:00100000:3.0:1790391418.888467:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790391418.888477:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186432384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790391418.888504:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391418.888599:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391418.888610:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186432512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391418.888639:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391418.888667:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186432512 00000100:00100000:0.0:1790391418.888671:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186432512 00000100:00100000:0.0:1790391418.888689:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790391418.888695:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186432512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391418.888717:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391418.888748:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186432512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391418.888756:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1790391418.888794:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51833c8380 x1877361186432512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391418.888814:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186432512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391418.889245:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186432384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 768us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391418.889252:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1790391418.889304:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51822eb480 x1877361186432384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391418.889317:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186432384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391419.797951:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391419.797988:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391419.798027:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391419.798045:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391419.798072:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391419.798102:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391419.798128:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169561344 00000100:00100000:3.0:1790391419.798152:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169561344 00000100:00100000:3.0:1790391419.798205:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169561472 00000100:00100000:3.0:1790391419.798208:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169561472 00000100:00100000:3.0:1790391419.798220:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169561856 00000100:00100000:3.0:1790391419.798222:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169561856 00000100:00100000:3.0:1790391419.798234:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169561728 00000100:00100000:3.0:1790391419.798250:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169561728 00000100:00100000:3.0:1790391419.798278:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 249 00000100:00100000:3.0:1790391419.798287:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169561344:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391419.798374:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169561344:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 86us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391419.798382:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 249 00000100:00100000:3.0:1790391419.798399:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 250 00000100:00100000:3.0:1790391419.798405:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169561472:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391419.798429:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169561472:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391419.798434:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 250 00000100:00100000:3.0:1790391419.798445:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 251 00000100:00100000:3.0:1790391419.798451:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169561856:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391419.798489:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169561856:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 38us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391419.798496:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 251 00000100:00100000:3.0:1790391419.798509:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 252 00000100:00100000:3.0:1790391419.798516:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169561728:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391419.798537:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169561728:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 22us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391419.798542:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 252 00000100:00100000:1.0:1790391419.798804:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169561216 00000100:00100000:1.0:1790391419.798811:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169561216 00000100:00080000:0.0:1790391419.798825:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391419.798832:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391419.798844:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169561600 00000100:00100000:0.0:1790391419.798849:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169561600 00000100:00100000:1.0:1790391419.798862:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 375 00000100:00100000:1.0:1790391419.798872:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2382:x1877361169561216:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391419.798931:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:1.0:1790391419.798941:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2382:x1877361169561216:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 69us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391419.798943:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2380:x1877361169561600:12345-192.168.202.28@tcp:9:kworker.0 00000100:00100000:1.0:1790391419.798956:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 375 00000020:00000080:0.0:1790391419.798970:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e1178 00000100:00080000:0.0:1790391419.798980:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9e51838d6000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1790391419.799033:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1790391419.800701:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1790391419.800930:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+2:2380:x1877361169561600:12345-192.168.202.28@tcp:9:kworker.0 Request processed in 1985us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391419.800940:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 27 00010000:00010000:0.0:1790391419.800974:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391419.850602:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391419.912194:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391419.912217:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186432640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391419.912294:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391419.912627:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186432640 00000100:00100000:2.0:1790391419.912636:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186432640 00000100:00100000:2.0:1790391419.912694:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790391419.912705:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186432640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391419.912750:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391419.912808:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186432640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391419.912815:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790391419.913043:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186432768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391419.913209:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391419.913301:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186432768 00000100:00100000:2.0:1790391419.913306:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186432768 00000100:00100000:2.0:1790391419.913336:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790391419.913343:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186432768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391419.913355:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391419.913400:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186432768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391419.913406:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790391419.913632:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186432640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391419.913823:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391419.913834:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186432896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391419.913900:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391419.914031:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186432768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391419.914160:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186432896 00000100:00100000:2.0:1790391419.914171:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186432896 00000100:00100000:2.0:1790391419.914205:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790391419.914212:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186432896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391419.914239:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790391419.914288:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186432896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391419.914295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790391419.914487:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186432896:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790391420.872977:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391421.896327:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391421.960686:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391421.960723:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186433024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391421.960792:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391421.962831:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186433024 00000100:00100000:2.0:1790391421.962845:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186433024 00000100:00100000:2.0:1790391421.962932:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790391421.962944:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186433024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391421.962985:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790391421.963499:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186433024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 556us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391421.963507:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790391421.965034:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186433024:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790391422.920407:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391423.496383:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186433408:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.496463:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391423.496517:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186433920:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.496543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391423.496568:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186434432:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.496590:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391423.496636:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790391423.496642:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186433280:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.496663:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391423.496869:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186433536:0@lo:400:kworker.0 00000100:00100000:0.0:1790391423.496937:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391423.496962:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186434048:0@lo:400:kworker.0 00000100:00100000:2.0:1790391423.497278:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186433920 00000100:00100000:2.0:1790391423.497288:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186433920 00000100:00100000:2.0:1790391423.497342:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186434432 00000100:00100000:2.0:1790391423.497345:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186434432 00000100:00100000:2.0:1790391423.497360:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186433280 00000100:00100000:2.0:1790391423.497363:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186433280 00000100:00100000:2.0:1790391423.497373:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186433536 00000100:00100000:2.0:1790391423.497375:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186433536 00000100:00100000:2.0:1790391423.497389:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790391423.497396:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186433920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391423.497476:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186433152:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.497539:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186433792:0@lo:400:kworker.0 00000100:00100000:2.0:1790391423.500200:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186433920:12345-0@lo:400:kworker.0 Request processed in 2796us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391423.500215:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790391423.500264:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790391423.500275:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186434432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391423.500326:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186434432:12345-0@lo:400:kworker.0 Request processed in 55us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391423.500332:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1790391423.500344:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1790391423.500351:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186433280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391423.500382:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186433280:12345-0@lo:400:kworker.0 Request processed in 32us (3718us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391423.500388:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1790391423.500399:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1790391423.500404:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186433536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391423.500432:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186433536:12345-0@lo:400:kworker.0 Request processed in 28us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391423.500437:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790391423.500578:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391423.500637:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186433664:0@lo:400:kworker.0 00000100:00100000:1.0:1790391423.500665:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391423.500694:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186434176:0@lo:400:kworker.0 00000100:00100000:1.0:1790391423.500727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391423.500751:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186434688:0@lo:400:kworker.0 00000100:00100000:1.0:1790391423.500774:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391423.504499:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391423.504567:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186434304:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.504638:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790391423.504691:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa30a80 x1877361186433920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391423.504705:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186433920:0@lo:400:kworker.0 00010000:00080000:3.0:1790391423.504720:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa31180 x1877361186434432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391423.504729:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186434432:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.504761:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186433280:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.504798:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186433408 00000100:00100000:3.0:1790391423.504805:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186433408 00000100:00100000:3.0:1790391423.504873:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186433664 00000100:00100000:3.0:1790391423.504894:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186433664 00000100:00100000:3.0:1790391423.504913:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790391423.504921:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186433408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.504980:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186433408:12345-0@lo:400:kworker.0 Request processed in 60us (8517us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391423.505175:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790391423.505196:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790391423.505204:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186433664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.505248:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186433664:12345-0@lo:400:kworker.0 Request processed in 45us (4581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391423.505254:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790391423.505275:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186433792 00000100:00100000:3.0:1790391423.505279:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186433792 00000100:00100000:3.0:1790391423.505302:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186434304 00000100:00100000:3.0:1790391423.505305:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186434304 00000100:00100000:3.0:1790391423.505320:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790391423.505326:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186433792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.505357:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186433792:12345-0@lo:400:kworker.0 Request processed in 30us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391423.505362:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1790391423.505373:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1790391423.505379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186434304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.505405:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186434304:12345-0@lo:400:kworker.0 Request processed in 26us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391423.505411:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:3.0:1790391423.505436:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391423.505446:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391423.505474:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186433664:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.505501:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186433792:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.505510:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186434304:0@lo:400:kworker.0 00000100:00100000:3.0:1790391423.505521:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186433408:0@lo:400:kworker.0 00000100:00100000:2.0:1790391423.505986:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186433152 00000100:00100000:2.0:1790391423.505998:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186433152 00000100:00100000:2.0:1790391423.506036:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1790391423.506042:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186433152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391423.506091:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186433152:12345-0@lo:400:kworker.0 Request processed in 49us (5513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391423.506107:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1790391423.506305:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186433152:0@lo:400:kworker.0 00000100:00100000:0.0:1790391423.506372:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391423.506420:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186434176 00000100:00100000:0.0:1790391423.506424:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186434176 00000100:00100000:2.0:1790391423.506478:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186434688 00000100:00100000:2.0:1790391423.506482:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186434688 00000100:00100000:0.0:1790391423.506525:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186434048 00000100:00100000:0.0:1790391423.506529:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186434048 00000100:00100000:1.0:1790391423.506561:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790391423.506570:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186434176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391423.506624:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186434176:12345-0@lo:400:kworker.0 Request processed in 56us (5896us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391423.506630:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1790391423.507951:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186434560:0@lo:400:kworker.0 00000100:00100000:1.0:1790391423.508025:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391423.508079:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186433536:0@lo:400:kworker.0 00000100:00080000:3.0:1790391423.510367:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391423.510377:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391423.510423:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186434176:0@lo:400:kworker.0 00000100:00100000:2.0:1790391423.511215:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186434560 00000100:00100000:2.0:1790391423.511224:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186434560 00000100:00100000:2.0:1790391423.511269:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790391423.511278:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186434688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391423.511372:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186434688:12345-0@lo:400:kworker.0 Request processed in 95us (10595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391423.511379:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790391423.511395:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790391423.511403:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186434560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391423.511439:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186434560:12345-0@lo:400:kworker.0 Request processed in 38us (3414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391423.511445:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:2.0:1790391423.511478:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa30e00 x1877361186434688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391423.511491:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186434688:0@lo:400:kworker.0 00010000:00080000:2.0:1790391423.511522:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa32a00 x1877361186434560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391423.511532:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186434560:0@lo:400:kworker.0 00000100:00100000:0.0:1790391423.513322:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790391423.513335:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186434048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391423.513426:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186434048:12345-0@lo:400:kworker.0 Request processed in 93us (7052us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391423.513433:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790391423.513616:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186434048:0@lo:400:kworker.0 00000100:00080000:3.0:1790391423.516258:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790391423.944308:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391424.008109:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000040:00080000:3.0:1790391424.008975:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790391424.012497:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186434944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391424.013692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391424.013760:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186434816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391424.013994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391424.014045:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186434944 00000100:00100000:1.0:1790391424.014053:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186434944 00000100:00100000:1.0:1790391424.014106:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186434816 00000100:00100000:1.0:1790391424.014109:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186434816 00000100:00100000:1.0:1790391424.014125:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790391424.014133:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186434944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391424.014164:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391424.014214:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186434944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391424.014228:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790391424.014243:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790391424.014249:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186434816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391424.014259:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391424.014284:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186434816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391424.014289:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1790391424.014327:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183a42d80 x1877361186434944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391424.014344:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186434944:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1790391424.014354:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51830a5500 x1877361186434816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391424.014364:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186434816:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1790391424.072584:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790391424.917119:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391424.917163:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391424.917201:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391424.917221:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391424.917243:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391424.917244:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169562112 00000100:00100000:1.0:1790391424.917253:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169562112 00000100:00100000:3.0:1790391424.917262:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169562368 00000100:00100000:3.0:1790391424.917265:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169562368 00000100:00100000:1.0:1790391424.917305:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169562240 00000100:00100000:1.0:1790391424.917309:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169562240 00000100:00100000:2.0:1790391424.917708:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169562496 00000100:00100000:2.0:1790391424.917714:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169562496 00000100:00100000:0.0:1790391424.922190:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 259 00000100:00100000:0.0:1790391424.922214:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169562112:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391424.922310:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169562112:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 108us (5201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391424.922318:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 259 00000100:00100000:3.0:1790391424.923850:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 260 00000100:00100000:3.0:1790391424.923866:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169562368:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391424.923951:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169562368:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 89us (6787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391424.923959:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 260 00000100:00100000:1.0:1790391424.927495:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 261 00000100:00100000:1.0:1790391424.927512:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169562240:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391424.927597:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169562240:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 90us (10375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391424.927605:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 261 00000100:00100000:2.0:1790391424.928431:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169561984 00000100:00100000:2.0:1790391424.928442:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169561984 00000100:00100000:2.0:1790391424.928483:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 377 00000100:00100000:2.0:1790391424.928491:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169561984:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391424.928536:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169561984:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 46us (11335us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391424.928561:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 377 00000100:00100000:2.0:1790391424.928616:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 262 00000100:00100000:2.0:1790391424.928624:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169562496:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391424.928656:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169562496:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 33us (11411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391424.928662:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 262 00000100:00080000:0.0:1790391424.937053:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391424.937063:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790391424.968184:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391425.037364:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391425.037393:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186435072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391425.037472:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391425.037847:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186435072 00000100:00100000:3.0:1790391425.037855:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186435072 00000100:00100000:3.0:1790391425.037974:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790391425.037985:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186435072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391425.038019:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790391425.038067:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186435072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391425.038074:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790391425.041174:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186435200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391425.041249:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391425.041325:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186435072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391425.041367:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186435200 00000100:00100000:2.0:1790391425.041374:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186435200 00000100:00100000:2.0:1790391425.041426:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790391425.041436:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186435200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391425.041464:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391425.041507:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186435200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391425.041514:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1790391425.041534:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391425.041559:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186435200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391425.046041:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186435328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391425.046123:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391425.046179:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186435328 00000100:00100000:1.0:1790391425.046187:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186435328 00000100:00100000:1.0:1790391425.046252:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790391425.046261:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186435328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391425.046284:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391425.046327:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186435328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391425.046335:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790391425.046378:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186435328:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790391425.047219:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1790391425.560719:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:3.0:1790391425.560728:0:8421:0:(genops.c:885:class_export_put()) final put ffff9e51838d4800/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:1.0:1790391425.564457:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e51838d4800/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d for lustre-OST0000 00000020:00000080:1.0:1790391425.564526:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e51838d6000 for lustre-OST0000 00010000:00010000:0.0:1790391425.994338:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391427.017678:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391427.080507:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518206c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186435456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391427.080588:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391427.080733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186435456 00000100:00100000:2.0:1790391427.080757:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186435456 00000100:00100000:2.0:1790391427.080814:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790391427.080824:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186435456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391427.080860:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790391427.080976:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186435456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391427.080983:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790391427.081297:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518206c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186435456:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790391428.045464:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391428.616765:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186435584:0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.616825:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186435968:0@lo:400:kworker.0 00000100:00100000:2.0:1790391428.616924:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186435712:0@lo:400:kworker.0 00000100:00100000:3.0:1790391428.616972:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186435840:0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.618519:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391428.618585:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186436480:0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.618631:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391428.618660:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186436992:0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.618682:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391428.618731:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186436480 00000100:00100000:1.0:1790391428.618739:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186436480 00000100:00100000:1.0:1790391428.618817:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186436992 00000100:00100000:1.0:1790391428.618821:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186436992 00000100:00100000:1.0:1790391428.618847:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790391428.618856:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186436480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.618930:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186436480:12345-0@lo:400:kworker.0 Request processed in 75us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.618938:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790391428.618952:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790391428.618959:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186436992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.618986:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186436992:12345-0@lo:400:kworker.0 Request processed in 28us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.618991:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790391428.619033:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186436480:0@lo:400:kworker.0 00010000:00080000:1.0:1790391428.619047:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa6fb80 x1877361186436992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391428.619086:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186436992:0@lo:400:kworker.0 00000100:00080000:1.0:1790391428.619131:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391428.619136:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391428.619153:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186435968 00000100:00100000:1.0:1790391428.619156:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186435968 00000100:00100000:1.0:1790391428.619186:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790391428.619192:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186435968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.619231:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186435968:12345-0@lo:400:kworker.0 Request processed in 39us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.619238:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790391428.619264:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186435968:0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.619501:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.619556:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186436096:0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.619591:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.619613:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186436608:0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.619706:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.619741:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186437120:0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.619768:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391428.619782:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186435584 00000100:00100000:1.0:1790391428.619789:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186435584 00000100:00100000:0.0:1790391428.619806:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186436608 00000100:00100000:0.0:1790391428.619812:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186436608 00000100:00100000:1.0:1790391428.619841:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1790391428.619850:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186435584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.619912:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186435584:12345-0@lo:400:kworker.0 Request processed in 63us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.619918:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:1.0:1790391428.619950:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391428.619958:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186437120 00000100:00100000:1.0:1790391428.619961:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186437120 00000100:00100000:1.0:1790391428.619987:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790391428.619994:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186437120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.620022:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186437120:12345-0@lo:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.620028:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1790391428.620043:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790391428.620082:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa6d180 x1877361186437120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391428.620093:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186437120:0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.620102:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186435584:0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.620207:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1790391428.620217:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186436608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391428.620384:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.620408:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186436608:12345-0@lo:400:kworker.0 Request processed in 191us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391428.620416:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790391428.620428:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186436224:0@lo:400:kworker.0 00000100:00100000:2.0:1790391428.620458:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.620479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186435712 00000100:00100000:2.0:1790391428.620482:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186436736:0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.620485:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186435712 00000100:00100000:2.0:1790391428.620514:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391428.620701:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186436224 00000100:00100000:0.0:1790391428.620706:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186436224 00000100:00100000:1.0:1790391428.620754:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186436736 00000100:00100000:1.0:1790391428.620760:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186436736 00000100:00100000:3.0:1790391428.620824:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.620852:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186436352:0@lo:400:kworker.0 00000100:00100000:3.0:1790391428.620895:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.620909:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186436864:0@lo:400:kworker.0 00000100:00100000:3.0:1790391428.620930:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391428.620956:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186436096 00000100:00100000:3.0:1790391428.620960:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186436096 00000100:00100000:3.0:1790391428.620985:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186435840 00000100:00100000:3.0:1790391428.620988:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186435840 00000100:00100000:3.0:1790391428.621001:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790391428.621008:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186436096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391428.621045:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186436096:12345-0@lo:400:kworker.0 Request processed in 38us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391428.621061:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790391428.621075:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790391428.621081:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186435840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391428.621113:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186435840:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391428.621132:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790391428.621163:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186435840:0@lo:400:kworker.0 00000100:00100000:2.0:1790391428.621235:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186436352 00000100:00100000:2.0:1790391428.621239:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186436352 00000100:00080000:3.0:1790391428.625637:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391428.625647:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391428.625677:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186436864 00000100:00100000:3.0:1790391428.625688:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186436864 00000100:00100000:0.0:1790391428.625819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1790391428.625833:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186435712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.627196:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790391428.627210:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186436224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.627213:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186435712:12345-0@lo:400:kworker.0 Request processed in 1383us (6826us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391428.627225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790391428.627262:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186436224:12345-0@lo:400:kworker.0 Request processed in 56us (6803us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.627284:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790391428.627303:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790391428.627311:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186436736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.627435:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186436096:0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.627451:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186436608:0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.627514:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186435712:0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.627525:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186436224:0@lo:400:kworker.0 00000100:00100000:1.0:1790391428.628066:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186436736:12345-0@lo:400:kworker.0 Request processed in 754us (7550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391428.628074:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1790391428.628126:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391428.628349:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790391428.628360:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186436864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391428.628443:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186436736:0@lo:400:kworker.0 00000100:00100000:2.0:1790391428.628543:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1790391428.628553:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186436352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391428.633730:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186436864:12345-0@lo:400:kworker.0 Request processed in 5363us (12787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391428.633747:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790391428.634294:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186436352:12345-0@lo:400:kworker.0 Request processed in 5740us (13414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391428.634303:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:1.0:1790391428.644989:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa6f800 x1877361186436864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391428.645011:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186436864:0@lo:400:kworker.0 00010000:00080000:1.0:1790391428.645064:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa6f480 x1877361186436352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391428.645074:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186436352:0@lo:400:kworker.0 00010000:00010000:0.0:1790391429.066815:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391429.128145:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391429.128180:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186437248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391429.128254:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391429.128417:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186437376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391429.128446:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391429.128534:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186437248 00000100:00100000:0.0:1790391429.128542:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186437248 00000100:00100000:0.0:1790391429.128594:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186437376 00000100:00100000:0.0:1790391429.128597:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186437376 00000100:00100000:0.0:1790391429.128616:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790391429.128634:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186437248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391429.128664:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391429.128714:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186437248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391429.128721:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790391429.128738:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790391429.128744:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186437376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391429.128756:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391429.128784:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186437376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391429.128791:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:1.0:1790391429.128872:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5292339500 x1877361186437376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391429.128932:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186437376:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1790391429.128964:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa6f480 x1877361186437248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391429.128997:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186437248:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1790391429.425293:0:14056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:57:08 (1790391428) 00000100:00100000:3.0:1790391430.030375:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391430.030423:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391430.030455:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391430.030491:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391430.030529:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391430.030559:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169563136 00000100:00100000:1.0:1790391430.030559:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169562880 00000100:00100000:3.0:1790391430.030569:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169563136 00000100:00100000:1.0:1790391430.030569:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169562880 00000100:00100000:3.0:1790391430.030621:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169562752 00000100:00100000:3.0:1790391430.030625:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169562752 00000100:00100000:2.0:1790391430.030677:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169562624 00000100:00100000:2.0:1790391430.030694:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169562624 00000100:00100000:2.0:1790391430.030729:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 379 00000100:00100000:2.0:1790391430.030740:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2382:x1877361169562624:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391430.030838:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2382:x1877361169562624:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 99us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391430.030846:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 379 00000100:00100000:0.0:1790391430.031195:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169563008 00000100:00100000:0.0:1790391430.031201:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169563008 00000100:00100000:2.0:1790391430.031301:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 269 00000100:00100000:2.0:1790391430.031312:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2382:x1877361169563136:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391430.031353:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2382:x1877361169563136:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 44us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391430.031360:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 269 00000100:00100000:1.0:1790391430.031598:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 270 00000100:00100000:1.0:1790391430.031606:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169562880:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391430.031641:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169562880:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 36us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391430.031648:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 270 00000100:00100000:3.0:1790391430.035860:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 271 00000100:00100000:3.0:1790391430.035889:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169562752:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391430.036787:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169562752:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 910us (6289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391430.036799:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 271 00000100:00100000:0.0:1790391430.037865:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 272 00000100:00100000:0.0:1790391430.037891:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2382:x1877361169563008:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391430.038236:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2382:x1877361169563008:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 357us (7702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391430.038260:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 272 00000100:00080000:2.0:1790391430.038411:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391430.038417:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1790391430.089738:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391430.152223:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391430.152251:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186437632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391430.152338:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391430.153488:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186437504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391430.153545:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391430.153582:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391430.153588:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186437760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391430.153611:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391430.153718:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186437504 00000100:00100000:3.0:1790391430.153740:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186437504 00000100:00100000:3.0:1790391430.153802:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790391430.153812:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186437504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391430.153856:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790391430.153942:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186437504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391430.153950:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790391430.153992:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186437504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391430.154720:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186437632 00000100:00100000:1.0:1790391430.154727:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186437632 00000100:00100000:2.0:1790391430.154751:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186437760 00000100:00100000:2.0:1790391430.154758:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186437760 00000100:00100000:2.0:1790391430.154796:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790391430.154806:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186437632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391430.154829:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1790391430.154831:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391430.154919:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186437632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (2580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391430.154968:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186437632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391430.157952:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790391430.157982:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186437760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790391430.158018:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391430.158141:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186437760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (4528us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391430.158150:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790391430.158342:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186437760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391430.159531:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790391430.650206:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391430.650317:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169563264 00000100:00100000:0.0:1790391430.650329:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169563264 00000100:00100000:0.0:1790391430.650398:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:0.0:1790391430.650409:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:11066:x1877361169563264:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391430.650430:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391430.650454:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0100 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391430.650518:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e125f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391430.650531:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e125f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391430.650544:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e125f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391430.650593:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790391430.650597:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391430.650839:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e125f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391430.650959:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0100 expref: 7 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391430.650979:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e125f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0100 expref: 6 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391430.650989:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5182c83800) 00010000:00010000:0.0:1790391430.650992:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391430.650997:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee600, rc 0) 00000100:00100000:0.0:1790391430.651077:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:11066:x1877361169563264:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 669us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391430.651083:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:3.0:1790391430.659533:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391430.659655:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169563392 00000100:00100000:2.0:1790391430.659669:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169563392 00000100:00100000:2.0:1790391430.659869:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 41 00000100:00100000:2.0:1790391430.659937:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:11067:x1877361169563392:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391430.659963:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391430.659990:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1266 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0107 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660086:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e126d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660103:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e126d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660118:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e126d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660134:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1274 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660142:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660148:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660218:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e127b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660226:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e127b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660233:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e127b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391430.660273:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790391430.660278:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391430.660303:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e127b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660325:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e126d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660332:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e126d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660340:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e126d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660346:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391430.660351:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e126d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660359:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e126d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660372:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5182c83800) 00010000:00010000:2.0:1790391430.660376:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391430.660382:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e126d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660389:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e126d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660402:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660409:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1274 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660415:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1274 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660426:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391430.660429:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1274 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660435:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1274 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660444:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e52b5d77100) 00010000:00010000:2.0:1790391430.660447:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391430.660450:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1274 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660456:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1274 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660495:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1266 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0107 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660511:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e127b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0107 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.660518:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e52b5d77e00) 00010000:00010000:2.0:1790391430.660520:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391430.660522:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d200, rc 0) 00000100:00100000:2.0:1790391430.660606:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:11067:x1877361169563392:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 673us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391430.665625:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 41 00000100:00100000:1.0:1790391430.666285:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391430.666347:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169563520 00000100:00100000:2.0:1790391430.666366:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169563520 00000100:00100000:2.0:1790391430.666410:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:2.0:1790391430.666419:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:11067:x1877361169563520:12345-192.168.202.28@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790391430.666500:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:11067:x1877361169563520:12345-192.168.202.28@tcp:900:lhsmtool_posix.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391430.666506:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:3.0:1790391430.676085:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391430.676165:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169563776 00000100:00100000:2.0:1790391430.676178:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169563776 00000100:00100000:2.0:1790391430.676248:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 42 00000100:00100000:2.0:1790391430.676259:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:11067:x1877361169563776:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391430.676280:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391430.676299:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1282 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b010e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.676375:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1289 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.676390:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.676401:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.676470:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1290 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.676479:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.676486:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.676607:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e1297 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.676616:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e1297 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.676624:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e1297 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391430.676633:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1790391430.678847:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.678864:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1289 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.678872:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1289 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.678898:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391430.678912:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1289 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.678921:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1289 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.678938:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e52b5d77e00) 00010000:00010000:2.0:1790391430.678941:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391430.678946:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1289 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.678974:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1289 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.678989:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.678995:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1290 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.679001:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1290 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.679006:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391430.679010:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1290 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.679016:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1290 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.679024:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e52b5d77100) 00010000:00010000:2.0:1790391430.679027:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391430.679038:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1290 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.679045:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1290 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.679355:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1282 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b010e expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.679369:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e1297 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b010e expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391430.679382:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:2.0:1790391430.679384:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391430.679387:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c800, rc 0) 00000100:00100000:2.0:1790391430.679466:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:11067:x1877361169563776:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 3209us (3393us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790391430.679474:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 42 00000100:00100000:3.0:1790391430.686864:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391430.688132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169563904 00000100:00100000:1.0:1790391430.688145:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169563904 00000100:00100000:1.0:1790391430.688217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 43 00000100:00100000:1.0:1790391430.688227:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:11067:x1877361169563904:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790391430.688344:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:11067:x1877361169563904:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 Request processed in 118us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391430.688362:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 43 00000100:00100000:1.0:1790391430.691127:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391430.691208:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169564032 00000100:00100000:0.0:1790391430.691217:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169564032 00000100:00100000:0.0:1790391430.691276:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:0.0:1790391430.691285:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:11067:x1877361169564032:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1790391430.692195:0:10091:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 870us 00000100:00100000:1.0:1790391430.708209:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:11067:x1877361169564032:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 Request processed in 16913us (17079us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391430.708225:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 44 00010000:00010000:2.0:1790391431.116923:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391431.240703:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1790391431.246154:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391432.143681:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391432.210701:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391432.210733:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186437888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391432.210832:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391432.210945:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186437888 00000100:00100000:3.0:1790391432.210956:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186437888 00000100:00100000:3.0:1790391432.211012:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790391432.211034:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186437888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391432.211079:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790391432.211148:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186437888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391432.211155:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790391432.211214:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186437888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391432.850558:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391432.850650:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169564160 00000100:00100000:1.0:1790391432.850664:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169564160 00000100:00100000:1.0:1790391432.850768:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00100000:1.0:1790391432.850781:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:11109:x1877361169564160:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391432.850810:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391432.850838:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e12a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0115 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.850974:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.850993:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851026:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851048:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851073:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851081:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851145:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851155:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851162:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851169:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391432.851174:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851183:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851196:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5182c83800) 00010000:00010000:1.0:1790391432.851199:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391432.851205:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851212:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851225:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851237:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851243:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851248:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391432.851251:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851257:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851265:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e5283a48800) 00010000:00010000:1.0:1790391432.851268:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391432.851270:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851276:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851318:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e12a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0115 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851330:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5182c83800) 00010000:00010000:1.0:1790391432.851332:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391432.851336:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e12a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0115 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391432.851345:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086e00, rc 0) 00000100:00100000:1.0:1790391432.851424:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:11109:x1877361169564160:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 647us (882us total) trans 0 rc 301/301 00000100:00100000:1.0:1790391432.851432:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00080000:3.0:1790391432.854620:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391432.861602:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391432.867233:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169564416 00000100:00100000:2.0:1790391432.867259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169564416 00000100:00100000:2.0:1790391432.867378:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:2.0:1790391432.867392:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:11109:x1877361169564416:12345-192.168.202.28@tcp:36:lfs.0 00010000:00010000:2.0:1790391432.867494:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391432.867541:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e125f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0100 expref: 9 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.867569:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5182c83800) 00010000:00010000:2.0:1790391432.867586:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391432.867707:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e12ba lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.867725:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e12ba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.867736:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e12ba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.867753:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.867781:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.867789:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868522:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868536:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868545:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391432.868564:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000878daca3 reply state 00000000f0e7ae2e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868577:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868584:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391432.868588:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790391432.868592:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790391432.868601:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1790391432.868609:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e12ba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868616:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e12ba lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868624:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e12ba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868638:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391432.868644:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e12ba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868653:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e12ba lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868664:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:2.0:1790391432.868666:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391432.868671:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e12ba lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868678:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e12ba lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391432.868695:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000878daca3 reply state 00000000f0e7ae2e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868703:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391432.868710:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e52b9b6cf00) 00010000:00010000:2.0:1790391432.868712:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790391432.868714:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790391432.868861:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:11109:x1877361169564416:12345-192.168.202.28@tcp:36:lfs.0 Request processed in 1469us (7281us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790391432.868872:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:3.0:1790391433.001366:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.002720:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169564544 00000100:00100000:1.0:1790391433.002843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169564544 00000100:00100000:1.0:1790391433.003435:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:1.0:1790391433.003449:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:11117:x1877361169564544:12345-192.168.202.28@tcp:101:lctl.0 00010000:00010000:1.0:1790391433.003495:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391433.003532:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b011c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.003641:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.003656:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.003667:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391433.003720:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790391433.003723:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391433.003770:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.003793:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e12cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b011c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.003808:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b011c expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.003836:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:1.0:1790391433.003839:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391433.003842:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086600, rc 0) 00000100:00100000:1.0:1790391433.003949:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:11117:x1877361169564544:12345-192.168.202.28@tcp:101:lctl.0 Request processed in 503us (2596us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391433.003957:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:0.0:1790391433.078270:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391433.078631:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169564672 00000100:00100000:3.0:1790391433.078644:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169564672 00000100:00100000:3.0:1790391433.078724:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 48 00000100:00100000:3.0:1790391433.078736:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:11123:x1877361169564672:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:3.0:1790391433.078762:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391433.078790:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e12dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0123 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.078921:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e12e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.078939:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e12e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.078955:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e12e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.078970:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e12eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.078977:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e12eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.078983:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e12eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079103:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ce00/0x2b1b7949f13e12f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079142:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ce00/0x2b1b7949f13e12f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079149:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ce00/0x2b1b7949f13e12f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391433.079197:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790391433.079201:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391433.079250:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ce00/0x2b1b7949f13e12f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079267:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e12e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079273:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e12e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079280:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e12e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079286:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391433.079291:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e12e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079575:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e12e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079673:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:3.0:1790391433.079678:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391433.079684:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e12e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079704:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e12e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079723:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e12eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079729:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e12eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079736:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e12eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079740:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763dc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391433.079743:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e12eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079750:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e12eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079758:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e52b9b6cf00) 00010000:00010000:3.0:1790391433.079760:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391433.079763:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e12eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079768:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e12eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079804:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e12dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0123 expref: 13 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079830:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ce00/0x2b1b7949f13e12f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0123 expref: 12 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.079838:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391433.079841:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790391433.079843:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763ce00, rc 0) 00000100:00100000:2.0:1790391433.080018:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+12:11123:x1877361169564672:12345-192.168.202.28@tcp:101:bash.0 Request processed in 1270us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391433.080029:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 48 00000100:00100000:3.0:1790391433.084497:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.084692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169564928 00000100:00100000:1.0:1790391433.084706:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169564928 00000100:00100000:1.0:1790391433.084801:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 49 00000100:00100000:1.0:1790391433.084813:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+12:11123:x1877361169564928:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:1.0:1790391433.084841:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391433.084868:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e12f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b012a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.085366:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1300 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.085386:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1300 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.085399:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1300 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.085414:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.085419:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.085442:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790391433.086409:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790391433.086617:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086632:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086643:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086686:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1300 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086695:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1300 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086703:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1300 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086709:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391433.086714:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1300 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086724:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1300 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086751:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:1.0:1790391433.086754:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391433.086773:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1300 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086781:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1300 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391433.086798:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092a89622 reply state 0000000025767fa8 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086812:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086818:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e5283a48900) 00010000:00010000:1.0:1790391433.086820:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391433.086822:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790391433.086859:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e12f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b012a expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086871:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b012a expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.086929:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:1.0:1790391433.086931:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391433.086933:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087000, rc 0) 00000100:00100000:1.0:1790391433.087027:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:11123:x1877361169564928:12345-192.168.202.28@tcp:101:bash.0 Request processed in 2215us (2544us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790391433.087037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 49 00000100:00100000:1.0:1790391433.093080:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391433.093149:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169565056 00000100:00100000:0.0:1790391433.093164:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169565056 00000100:00100000:0.0:1790391433.093227:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:0.0:1790391433.093238:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2380:x1877361169565056:12345-192.168.202.28@tcp:8:bash.0 00010000:00080000:0.0:1790391433.093286:0:9796:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:0.0:1790391433.093340:0:9796:0:(genops.c:1385:class_connect()) connect: client 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d, cookie 0x2b1b7949f13e131c 00002000:00100000:0.0:1790391433.093356:0:9796:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d/ffff9e5183a17800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391433.093400:0:9796:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790391433.093714:0:9796:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790391433.093759:0:9796:0:(import.c:65:import_set_state_nolock()) ffff9e5183a15000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391433.093855:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2380:x1877361169565056:12345-192.168.202.28@tcp:8:bash.0 Request processed in 616us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391433.093864:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:3.0:1790391433.096444:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.096975:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169565184 00000100:00100000:1.0:1790391433.096990:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169565184 00000100:00100000:1.0:1790391433.097104:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:1.0:1790391433.097117:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:0:x1877361169565184:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:1.0:1790391433.097141:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391433.097170:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e1323 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0131 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391433.097204:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790391433.097229:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1790391433.097235:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391433.097247:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e1323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0131 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.097272:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e1323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0131 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.097288:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087200, rc 0) 00000100:00100000:1.0:1790391433.097363:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:0:x1877361169565184:12345-192.168.202.28@tcp:101:bash.0 Request processed in 249us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391433.097370:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00080000:3.0:1790391433.098840:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391433.103956:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391433.104190:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169565312 00000100:00100000:0.0:1790391433.104205:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169565312 00000100:00100000:0.0:1790391433.104287:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:0.0:1790391433.104298:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:11123:x1877361169565312:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:0.0:1790391433.104325:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391433.104355:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0138 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.104398:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e1323 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0131 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.104408:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391433.104413:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391433.104418:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.104462:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e1323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0131 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.104477:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e1323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0131 expref: 8 pid: 8429 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391433.104510:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b7793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1877361186438016:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391433.104745:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391433.109322:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b7793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1877361186438016:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391433.109371:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.109398:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefc00, rc 0) 00000100:00100000:0.0:1790391433.109474:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:11123:x1877361169565312:12345-192.168.202.28@tcp:101:bash.0 Request processed in 5176us (5533us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391433.109492:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:3.0:1790391433.115839:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.118782:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169565440 00000100:00100000:1.0:1790391433.118805:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169565440 00010000:00010000:2.0:1790391433.119063:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e1323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0131 expref: 8 pid: 8429 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391433.119121:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:2.0:1790391433.119133:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169565440:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391433.119153:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391433.119180:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e1323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0131 expref: 8 pid: 8429 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.119196:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e1323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0131 expref: 8 pid: 8429 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.119227:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e1323 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0131 expref: 8 pid: 8429 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.119249:0:10388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391433.119255:0:10388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391433.119265:0:10388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.119277:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.119327:0:10388:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391433.119371:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10388:1877361186438144:192.168.202.28@tcp:105: 00000100:00100000:2.0:1790391433.121241:0:10388:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52892fccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391433.134805:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10388:1877361186438144:192.168.202.28@tcp:105: 00010000:00010000:2.0:1790391433.134848:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391433.138179:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169565440:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 19028us (22338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391433.138199:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:0.0:1790391433.140521:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.140775:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169565696 00000100:00100000:1.0:1790391433.140789:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169565696 00000100:00100000:1.0:1790391433.140870:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:1.0:1790391433.140912:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:11123:x1877361169565696:12345-192.168.202.28@tcp:35:bash.0 00000100:00100000:1.0:1790391433.141307:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:11123:x1877361169565696:12345-192.168.202.28@tcp:35:bash.0 Request processed in 397us (799us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790391433.141334:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 6 00010000:00010000:0.0:1790391433.161673:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391433.233648:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.233835:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169565952 00000100:00100000:2.0:1790391433.233848:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169565952 00000100:00100000:2.0:1790391433.233966:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 50 00000100:00100000:2.0:1790391433.233979:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:11134:x1877361169565952:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391433.234022:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391433.234050:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b013f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391433.234194:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1790391433.234329:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1331 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b013f expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.234346:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:2.0:1790391433.234349:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391433.234355:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b013f expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.234372:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c200, rc 0) 00000100:00100000:2.0:1790391433.234476:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:11134:x1877361169565952:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 500us (845us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1790391433.234484:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 50 00000100:00100000:0.0:1790391433.239391:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.239751:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169566208 00000100:00100000:1.0:1790391433.239762:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169566208 00000100:00100000:1.0:1790391433.239828:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:1.0:1790391433.239850:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:11134:x1877361169566208:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391433.241142:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:11134:x1877361169566208:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 1299us (1754us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1790391433.241152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:3.0:1790391433.357445:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.357729:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169566336 00000100:00100000:2.0:1790391433.357744:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169566336 00000100:00100000:2.0:1790391433.357828:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:2.0:1790391433.357841:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:11140:x1877361169566336:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391433.357924:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391433.357956:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e133f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0146 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.358067:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1346 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.358086:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1346 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.358102:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1346 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391433.358162:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790391433.358167:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391433.358193:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1346 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.358225:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e133f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0146 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.358249:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1346 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0146 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.358284:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391433.358287:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391433.358292:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d800, rc 0) 00000100:00100000:2.0:1790391433.358390:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:11140:x1877361169566336:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 552us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391433.358399:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:0.0:1790391433.369366:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.369485:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169566592 00000100:00100000:2.0:1790391433.369508:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169566592 00000100:00100000:2.0:1790391433.369607:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:2.0:1790391433.369622:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:11140:x1877361169566592:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391433.369652:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391433.369681:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e134d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b014d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.369845:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1354 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.369864:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.369913:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391433.369928:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790391433.370107:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e134d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b014d expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.370159:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1354 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b014d expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.370169:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:2.0:1790391433.370173:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391433.370178:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309cc00, rc 0) 00000100:00100000:2.0:1790391433.370267:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:11140:x1877361169566592:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 648us (927us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1790391433.370276:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:3.0:1790391433.375991:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.376376:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169566848 00000100:00100000:2.0:1790391433.376390:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169566848 00000100:00100000:2.0:1790391433.376466:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:2.0:1790391433.376478:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:11140:x1877361169566848:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391433.376520:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391433.376547:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1362 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0154 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.377125:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1369 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.377146:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.377161:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391433.377176:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790391433.378798:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1362 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0154 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.378844:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1369 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0154 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.378855:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:2.0:1790391433.378858:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790391433.378863:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d000, rc 0) 00000100:00100000:2.0:1790391433.379000:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:11140:x1877361169566848:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 2523us (3023us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790391433.380651:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:0.0:1790391433.382204:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.384657:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169566976 00000100:00100000:2.0:1790391433.384679:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169566976 00000100:00100000:2.0:1790391433.384779:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:2.0:1790391433.384790:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:2381:x1877361169566976:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391433.384811:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391433.384843:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1354 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b014d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.384870:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:2.0:1790391433.384913:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391433.384992:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:2381:x1877361169566976:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 203us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391433.385000:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:0.0:1790391433.394670:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.395195:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169567104 00000100:00100000:1.0:1790391433.395212:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169567104 00000100:00100000:1.0:1790391433.395291:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:1.0:1790391433.395303:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169567104:12345-192.168.202.28@tcp:1:lfs.0 00010000:00010000:1.0:1790391433.395354:0:9796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.395375:0:9796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.395385:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391433.395389:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391433.395394:0:9796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.395428:0:9796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.395461:0:9796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 7 pid: 8428 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391433.395476:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9796:1877361186438272:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391433.395581:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183898cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391433.403204:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9796:1877361186438272:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391433.403234:0:9796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391433.406497:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.406600:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169567232 00000100:00100000:2.0:1790391433.406609:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169567232 00002000:00100000:2.0:1790391433.406741:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9e51820ac000 x1877361169567232/t0(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:299/0 lens 504/0 e 0 to 0 dl 1790391444 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790391433.406751:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e51820ac000 with x1877361169567232 ext(0->12) 00010000:00010000:2.0:1790391433.406761:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 8 pid: 8428 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.406777:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 8 pid: 8428 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391433.406784:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e51820ac000 00000100:00100000:2.0:1790391433.406833:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:2.0:1790391433.406844:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169567232:12345-192.168.202.28@tcp:4:lfs.0 00000001:00100000:0.0:1790391433.412993:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000100:00100000:3.0:1790391433.414154:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2384:x1877361169567232:12345-192.168.202.28@tcp:4:lfs.0 Request processed in 7303us (7655us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790391433.414172:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00002000:00100000:3.0:1790391433.414195:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9e51820ac000 x1877361169567232/t4294967300(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:299/0 lens 504/448 e 0 to 0 dl 1790391444 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790391433.414206:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e51820ac000 with x1877361169567232 ext(0->12) 00010000:00010000:3.0:1790391433.414217:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 9 pid: 8428 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.414237:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 9 pid: 8428 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790391433.414263:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e51820ac000 00000100:00100000:3.0:1790391433.429088:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.431554:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169567360 00000100:00100000:1.0:1790391433.431569:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169567360 00010000:00010000:1.0:1790391433.431633:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 9 pid: 8428 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391433.431689:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:1.0:1790391433.431699:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2383:x1877361169567360:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391433.431714:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790391433.431733:0:6499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790391433.431736:0:6499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1790391433 00002000:00010000:1.0:1790391433.431738:0:6499:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1790391433 00002000:00010000:1.0:1790391433.431740:0:6499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1790391433 00002000:00010000:1.0:1790391433.431742:0:6499:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1790391433.431748:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 9 pid: 8428 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.431784:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 9 pid: 8428 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.431820:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6c5a124/0x2b1b7949f13e132a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0138 expref: 9 pid: 8428 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.431837:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391433.431841:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391433.431848:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.431858:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.432432:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391433.432491:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169567360:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 793us (3412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391433.432500:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 53 00010000:00010000:0.0:1790391433.432666:0:9796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.432676:0:9796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.432711:0:9796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.432719:0:9796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.432726:0:9796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.432733:0:9796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391433.432737:0:9796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.432746:0:9796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.432762:0:9796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391433.432770:0:9796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000909c206/0x2b1b7949f13e1377 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391433.432842:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169567104:12345-192.168.202.28@tcp:1:lfs.0 Request processed in 37541us (38188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391433.432851:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:0.0:1790391433.440696:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.440765:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169567616 00000100:00100000:1.0:1790391433.440775:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169567616 00000100:00100000:1.0:1790391433.440835:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:1.0:1790391433.440845:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:11140:x1877361169567616:12345-192.168.202.28@tcp:35:lfs.0 00000004:00010000:1.0:1790391433.440956:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1369 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0154 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391433.441198:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1790391433.441246:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1790391433.441538:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1790391433.441576:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.441592:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b012a expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.441601:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.441634:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b012a expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.441650:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b012a expref: 26 pid: 6514 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391433.441666:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1877361186438400:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391433.441746:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183898cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391433.445306:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1877361186438400:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391433.445339:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391433.446224:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.446308:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169567744 00000100:00100000:2.0:1790391433.446316:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169567744 00010000:00010000:2.0:1790391433.446355:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b012a expref: 27 pid: 6514 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391433.446395:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:2.0:1790391433.446404:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:2383:x1877361169567744:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391433.446418:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391433.446425:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b012a expref: 27 pid: 6514 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.446439:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b012a expref: 27 pid: 6514 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.446478:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e130e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b012a expref: 27 pid: 6514 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.446493:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:2.0:1790391433.446499:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.446508:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.446516:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.446545:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391433.446604:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+26:2383:x1877361169567744:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 201us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391433.446612:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 54 00010000:00010000:3.0:1790391433.446945:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391433.446953:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391433.447071:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1790391433.447188:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1790391433.447277:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa31f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877361186438528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790391433.447327:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391433.447364:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5289676180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391433.447482:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186438528 00000100:00100000:0.0:1790391433.447488:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186438528 00000100:00100000:0.0:1790391433.447547:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790391433.447555:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1877361186438528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790391433.447638:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1877361186438528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391433.447645:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1790391433.447868:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391433.448003:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa31f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877361186438528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790391433.448159:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1790391433.448207:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877361186438656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790391433.448238:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391433.448263:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52892fce40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391433.448351:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186438656 00000100:00100000:3.0:1790391433.448357:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186438656 00000100:00100000:3.0:1790391433.448383:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790391433.448390:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1877361186438656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790391433.448496:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1877361186438656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 107us (257us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790391433.448503:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790391433.448916:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877361186438656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790391433.448956:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1790391433.448989:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.449025:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.449034:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.449041:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391433.449046:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.449056:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.449072:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:2.0:1790391433.449076:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790391433.449081:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.449088:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e137e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391433.449181:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790391433.450396:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1790391433.450415:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346817537399ns, next at 347817533149ns, rc = 0 00000001:00080000:2.0:1790391433.450427:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1790391433.450470:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:2.0:1790391433.450474:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790391433.450484:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1369 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0154 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391433.450642:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:11140:x1877361169567616:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 9797us (9956us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1790391433.450664:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 8 00000020:00080000:2.0:1790391433.450670:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790391433.460126:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.460291:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169567872 00000100:00100000:2.0:1790391433.460302:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169567872 00000100:00100000:2.0:1790391433.460367:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:2.0:1790391433.460378:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:11140:x1877361169567872:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391433.460403:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391433.460424:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1385 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b015b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.460486:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b015b expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.460499:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b015b expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.460515:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:2.0:1790391433.460519:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391433.460523:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d000, rc 0) 00000100:00100000:2.0:1790391433.460579:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:11140:x1877361169567872:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 203us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391433.460598:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:1.0:1790391433.466622:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.466820:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169568128 00000100:00100000:2.0:1790391433.466830:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169568128 00000100:00100000:2.0:1790391433.466945:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:2.0:1790391433.466957:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:11140:x1877361169568128:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:2.0:1790391433.467836:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+31:11140:x1877361169568128:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 877us (1218us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1790391433.467846:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:0.0:1790391433.594354:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.595177:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169568384 00000100:00100000:1.0:1790391433.595199:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169568384 00000100:00100000:1.0:1790391433.595267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:1.0:1790391433.595278:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+31:11150:x1877361169568384:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391433.595304:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391433.595326:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e138c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0162 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391433.595444:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790391433.595543:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e138c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0162 expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.595559:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:1.0:1790391433.595563:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391433.595567:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e138c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0162 expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391433.595580:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086400, rc 0) 00000100:00100000:1.0:1790391433.596356:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:11150:x1877361169568384:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 1076us (2008us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1790391433.596365:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:3.0:1790391433.609905:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.610055:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169568512 00000100:00100000:2.0:1790391433.610066:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169568512 00000100:00100000:2.0:1790391433.610127:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:2.0:1790391433.610137:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:11150:x1877361169568512:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:2.0:1790391433.610224:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e139a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610243:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e139a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610256:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e139a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610267:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610274:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610281:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610353:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610381:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610389:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391433.610441:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610454:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e139a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610461:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e139a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610468:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e139a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610475:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309cc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391433.610479:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e139a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610486:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e139a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610498:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391433.610501:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391433.610506:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e139a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610512:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e139a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610532:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610538:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610544:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610549:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391433.610553:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610559:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610566:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e5283a48900) 00010000:00010000:2.0:1790391433.610569:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391433.610571:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610576:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610599:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610605:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610610:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610622:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309dc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391433.610625:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610631:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610639:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:2.0:1790391433.610641:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391433.610645:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.610649:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391433.610997:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:11150:x1877361169568512:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 858us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391433.611019:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:0.0:1790391433.622342:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391433.625410:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169568768 00000100:00100000:3.0:1790391433.625439:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169568768 00000100:00100000:3.0:1790391433.625508:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:3.0:1790391433.625517:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:11150:x1877361169568768:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:3.0:1790391433.625767:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:11150:x1877361169568768:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 250us (3446us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1790391433.625775:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:0.0:1790391433.681263:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.681403:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169569024 00000100:00100000:2.0:1790391433.681417:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169569024 00000100:00100000:2.0:1790391433.681498:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:2.0:1790391433.681512:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:11153:x1877361169569024:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391433.681545:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391433.681573:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0169 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.681813:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.681852:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.681868:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.681970:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e13bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.681978:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e13bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.681986:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e13bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682140:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682149:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682157:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391433.682168:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790391433.682277:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682285:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682292:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682306:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391433.682312:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682321:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682336:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391433.682339:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391433.682345:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682351:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e13b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682368:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e13bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682374:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e13bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682380:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e13bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682385:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309cc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391433.682387:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e13bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682394:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e13bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682414:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e5283a48900) 00010000:00010000:2.0:1790391433.682417:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391433.682421:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e13bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682427:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e13bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682475:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0169 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682491:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0169 expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.682500:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:2.0:1790391433.682502:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391433.682506:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ce00, rc 0) 00000100:00100000:2.0:1790391433.682727:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:11153:x1877361169569024:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 1216us (1480us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1790391433.682737:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:0.0:1790391433.690743:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391433.690852:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169569152 00000100:00100000:2.0:1790391433.690866:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169569152 00000100:00100000:2.0:1790391433.691175:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00100000:2.0:1790391433.691190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:11153:x1877361169569152:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:2.0:1790391433.691289:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.691322:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.691358:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.691407:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.691415:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.691423:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.691430:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391433.691436:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.691444:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.691458:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:2.0:1790391433.691462:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391433.691468:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391433.691474:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391433.692342:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:11153:x1877361169569152:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 1148us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391433.692354:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00100000:0.0:1790391433.699595:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391433.699816:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169569408 00000100:00100000:1.0:1790391433.699830:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169569408 00000100:00100000:1.0:1790391433.699945:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:1.0:1790391433.699958:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:11153:x1877361169569408:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391433.700299:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:11153:x1877361169569408:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 344us (730us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1790391433.700308:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:0.0:1790391433.736355:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186439040:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.736456:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391433.736540:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186439552:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.736594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391433.736619:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186440064:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.736640:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391433.736668:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790391433.736673:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186438912:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.736693:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391433.736706:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186439424:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.736724:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391433.736756:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186439936:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.736776:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391433.736800:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186439552 00000100:00100000:0.0:1790391433.736808:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186439552 00000100:00100000:0.0:1790391433.736860:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186440064 00000100:00100000:0.0:1790391433.736862:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186440064 00000100:00100000:0.0:1790391433.736914:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186438912 00000100:00100000:0.0:1790391433.736917:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186438912 00000100:00100000:0.0:1790391433.736929:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186439424 00000100:00100000:0.0:1790391433.736932:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186439424 00000100:00100000:0.0:1790391433.736943:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186439936 00000100:00100000:0.0:1790391433.736945:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186439936 00000100:00100000:0.0:1790391433.736961:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790391433.736970:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186439552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.737038:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186439552:12345-0@lo:400:kworker.0 Request processed in 69us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391433.737046:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00010000:00080000:0.0:1790391433.737090:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51832ce680 x1877361186439552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391433.737104:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186439552:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.737130:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1790391433.737136:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186440064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.737168:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186440064:12345-0@lo:400:kworker.0 Request processed in 32us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391433.737174:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1790391433.737185:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1790391433.737190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186438912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.737226:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186438912:12345-0@lo:400:kworker.0 Request processed in 36us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391433.737232:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1790391433.737245:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790391433.737250:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186439424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.737272:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186439424:12345-0@lo:400:kworker.0 Request processed in 22us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391433.737277:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790391433.737286:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1790391433.737291:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186439936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.737316:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186439936:12345-0@lo:400:kworker.0 Request processed in 24us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391433.737322:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1790391433.737345:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186438912:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.737354:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186439424:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.737363:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186439936:0@lo:400:kworker.0 00010000:00080000:0.0:1790391433.737372:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51832cf100 x1877361186440064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391433.737381:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186440064:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.737629:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186438784:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.737675:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391433.737714:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186439296:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.737741:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391433.737762:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186439808:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.737789:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391433.737807:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186440320:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.737830:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391433.737850:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790391433.737856:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186439168:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.737906:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391433.737925:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186439680:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.737947:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391433.737963:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186440192:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.737986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391433.738034:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186439808 00000100:00100000:3.0:1790391433.738040:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186439808 00000100:00100000:3.0:1790391433.738076:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186440320 00000100:00100000:3.0:1790391433.738079:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186440320 00000100:00100000:3.0:1790391433.738109:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186439680 00000100:00100000:3.0:1790391433.738112:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186439680 00000100:00100000:3.0:1790391433.738128:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186440192 00000100:00100000:3.0:1790391433.738131:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186440192 00000100:00100000:3.0:1790391433.738148:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790391433.738154:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186439808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738199:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186439808:12345-0@lo:400:kworker.0 Request processed in 45us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391433.738206:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790391433.738220:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790391433.738226:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186440320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738272:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186440320:12345-0@lo:400:kworker.0 Request processed in 46us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391433.738278:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790391433.738290:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790391433.738308:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186439680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738337:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186439680:12345-0@lo:400:kworker.0 Request processed in 42us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391433.738343:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790391433.738354:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790391433.738360:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186440192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738386:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186440192:12345-0@lo:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391433.738392:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1790391433.738411:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391433.738416:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391433.738419:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391433.738428:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391433.738443:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186439040 00000100:00100000:3.0:1790391433.738448:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186439040 00000100:00100000:3.0:1790391433.738475:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186439296 00000100:00100000:3.0:1790391433.738488:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186439296 00000100:00100000:3.0:1790391433.738504:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790391433.738510:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186439040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738550:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186439040:12345-0@lo:400:kworker.0 Request processed in 40us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391433.738556:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790391433.738567:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790391433.738572:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186439296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738599:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186439296:12345-0@lo:400:kworker.0 Request processed in 27us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391433.738605:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790391433.738640:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186439680:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738651:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186440192:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738660:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186439296:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738670:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186439808:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738679:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186440320:0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738716:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186439168 00000100:00100000:3.0:1790391433.738720:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186439168 00000100:00100000:3.0:1790391433.738741:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1790391433.738747:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186439168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391433.738783:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186439168:12345-0@lo:400:kworker.0 Request processed in 36us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391433.738796:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1790391433.738821:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186439168:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.739253:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186438784 00000100:00100000:0.0:1790391433.739260:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186438784 00000100:00100000:1.0:1790391433.739609:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186439040:0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.739680:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1790391433.739690:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186438784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391433.739768:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186438784:12345-0@lo:400:kworker.0 Request processed in 81us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391433.739774:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1790391433.739852:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186438784:0@lo:400:kworker.0 00000100:00100000:0.0:1790391434.065826:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391434.068285:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169569664 00000100:00100000:3.0:1790391434.068338:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169569664 00000100:00100000:3.0:1790391434.068548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:3.0:1790391434.068562:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:11184:x1877361169569664:12345-192.168.202.28@tcp:101:cat.0 00010000:00010000:3.0:1790391434.068597:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391434.068629:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e13d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0170 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.068771:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e13e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.068786:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e13e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.068797:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e13e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391434.068807:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790391434.068959:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e13d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0170 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.069069:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e13e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0170 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.069104:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391434.069107:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391434.069112:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763dc00, rc 0) 00000100:00100000:3.0:1790391434.069191:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:11184:x1877361169569664:12345-192.168.202.28@tcp:101:cat.0 Request processed in 633us (3380us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1790391434.069197:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00080000:0.0:1790391434.074516:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391434.075221:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391434.075735:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169569792 00000100:00100000:2.0:1790391434.075770:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169569792 00000100:00100000:2.0:1790391434.075927:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:2.0:1790391434.075939:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:2381:x1877361169569792:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391434.075958:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391434.076010:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e13e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0170 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.076034:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:2.0:1790391434.076040:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391434.076115:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:2381:x1877361169569792:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 177us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391434.076123:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:3.0:1790391434.076562:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391434.076609:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169570048 00000100:00100000:0.0:1790391434.076615:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169570048 00000100:00100000:0.0:1790391434.076662:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:0.0:1790391434.076670:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:11184:x1877361169570048:12345-192.168.202.28@tcp:35:cat.0 00000100:00100000:0.0:1790391434.077019:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:11184:x1877361169570048:12345-192.168.202.28@tcp:35:cat.0 Request processed in 348us (461us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1790391434.077028:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:1.0:1790391434.152833:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391434.152968:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169570304 00000100:00100000:2.0:1790391434.153159:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169570304 00000100:00100000:2.0:1790391434.153246:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:2.0:1790391434.153260:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:11190:x1877361169570304:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:2.0:1790391434.153305:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391434.153309:0:10091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790391434.153344:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1346 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0146 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.153370:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391434.153376:0:10091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391434.153395:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13ee lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0177 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.153539:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.153574:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0169 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.153583:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.153625:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0169 expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.153641:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0169 expref: 38 pid: 6513 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391434.153658:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186440448:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391434.153793:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52892fcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391434.161687:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391434.162124:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169570432 00000100:00100000:1.0:1790391434.162159:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169570432 00010000:00010000:1.0:1790391434.162218:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0169 expref: 39 pid: 6513 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391434.162273:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:1.0:1790391434.162286:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:2383:x1877361169570432:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391434.162316:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391434.162325:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0169 expref: 39 pid: 6513 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.162341:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0169 expref: 39 pid: 6513 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.162370:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391434.162376:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.162388:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.162397:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.162422:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391434.162509:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:2383:x1877361169570432:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 226us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391434.162518:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 55 00010000:00010000:2.0:1790391434.167065:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e13c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0169 expref: 38 pid: 6513 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391434.167104:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186440448:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391434.167139:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.167151:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.167157:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391434.167187:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790391434.167430:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e13ee lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0177 expref: 39 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.167448:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0177 expref: 38 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.167460:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:2.0:1790391434.167463:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790391434.167467:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309dc00, rc 0) 00000100:00100000:2.0:1790391434.167852:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:11190:x1877361169570304:12345-192.168.202.28@tcp:101:dd.0 Request processed in 14592us (15029us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1790391434.167864:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:0.0:1790391434.174500:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391434.174735:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169570560 00000100:00100000:3.0:1790391434.174750:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169570560 00000100:00100000:3.0:1790391434.174835:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:3.0:1790391434.174848:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:11190:x1877361169570560:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:3.0:1790391434.174920:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391434.174954:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e1403 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b017e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.175010:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.175027:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.175042:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.175207:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e1403 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b017e expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.175243:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b017e expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.175253:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391434.175257:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391434.175261:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d000, rc 0) 00000100:00100000:3.0:1790391434.175348:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:11190:x1877361169570560:12345-192.168.202.28@tcp:101:dd.0 Request processed in 503us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391434.175357:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:3.0:1790391434.180432:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391434.181628:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169570816 00000100:00100000:1.0:1790391434.181644:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169570816 00000100:00100000:1.0:1790391434.181750:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 62 00000100:00100000:1.0:1790391434.181761:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:11190:x1877361169570816:12345-192.168.202.28@tcp:36:dd.0 00010000:00010000:1.0:1790391434.182126:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.182149:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.182163:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391434.182209:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1790391434.182229:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041286169 reply state 00000000262db556 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.182243:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.182251:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391434.182255:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391434.182260:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391434.182371:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+42:11190:x1877361169570816:12345-192.168.202.28@tcp:36:dd.0 Request processed in 609us (1952us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1790391434.182378:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 62 00000020:00080000:1.0:1790391434.182383:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790391434.184162:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391434.248339:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186440576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391434.248457:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391434.248657:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186440576 00000100:00100000:3.0:1790391434.248669:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186440576 00000100:00100000:3.0:1790391434.248744:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790391434.248755:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186440576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790391434.248784:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391434.248962:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186440704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391434.249013:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391434.249081:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186440704 00000100:00100000:1.0:1790391434.249085:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186440704 00000100:00100000:1.0:1790391434.249109:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790391434.249116:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186440704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391434.249136:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391434.249173:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186440704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391434.249180:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790391434.249230:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186440704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391434.251573:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186440576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2803us (3100us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391434.251594:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790391434.252213:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186440576:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1790391434.313053:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1790391434.313300:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790391434.547829:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391434.548698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169570944 00000100:00100000:3.0:1790391434.548715:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169570944 00000100:00100000:3.0:1790391434.548816:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:3.0:1790391434.548843:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+42:11204:x1877361169570944:12345-192.168.202.28@tcp:101:stat.0 00010000:00010000:3.0:1790391434.548917:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391434.548948:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e1418 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0185 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549589:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e141f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549610:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e141f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549626:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e141f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549640:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1426 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549647:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1426 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549654:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1426 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549755:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549769:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0177 expref: 43 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549779:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549827:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0177 expref: 43 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.549861:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0177 expref: 43 pid: 10091 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391434.549916:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186440832:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391434.550772:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aee40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391434.556650:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391434.558428:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169571200 00000100:00100000:1.0:1790391434.558448:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169571200 00000100:00100000:1.0:1790391434.558553:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:1.0:1790391434.558566:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+44:6156:x1877361169571200:12345-192.168.202.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790391434.559053:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+45:6156:x1877361169571200:12345-192.168.202.28@tcp:35:ldlm_bl.0 Request processed in 488us (2416us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1790391434.559063:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:3.0:1790391434.559318:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186440832:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391434.559351:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391434.563176:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391434.563277:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169571328 00000100:00100000:1.0:1790391434.563290:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169571328 00010000:00010000:1.0:1790391434.563346:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0177 expref: 45 pid: 10091 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391434.563397:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:1.0:1790391434.563408:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+45:2381:x1877361169571328:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391434.563427:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391434.563435:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0177 expref: 45 pid: 10091 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.563450:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0177 expref: 45 pid: 10091 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.563496:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e13f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0177 expref: 45 pid: 10091 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.563515:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391434.563521:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.563532:0:10388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.563541:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.563711:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391434.563751:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.563764:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391434.563786:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+44:2381:x1877361169571328:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 379us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391434.563796:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 56 00000004:00200000:3.0:1790391434.563838:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790391434.563844:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391434.563935:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.563953:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.563964:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e141f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.563973:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e141f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565695:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e141f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565703:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391434.565709:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e141f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565723:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e141f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565744:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391434.565747:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391434.565752:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e141f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565760:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e141f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565781:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1426 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565788:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1426 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565794:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1426 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565799:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391434.565801:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1426 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565816:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1426 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565824:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e5283a48900) 00010000:00010000:3.0:1790391434.565826:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391434.565829:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1426 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565835:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1426 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565902:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e1418 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0185 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565918:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0185 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.565924:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391434.565926:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391434.565929:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c000, rc 0) 00000100:00100000:3.0:1790391434.566103:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+43:11204:x1877361169570944:12345-192.168.202.28@tcp:101:stat.0 Request processed in 17273us (18287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391434.566114:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:0.0:1790391434.637278:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391434.637722:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169571584 00000100:00100000:1.0:1790391434.637736:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169571584 00000100:00100000:1.0:1790391434.638102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:1.0:1790391434.638116:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+43:11210:x1877361169571584:12345-192.168.202.28@tcp:36:truncate.0 00010000:00010000:1.0:1790391434.638198:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391434.638238:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e142d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0185 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.638263:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391434.638270:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391434.638527:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.638547:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.638573:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391434.638625:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1790391434.638650:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003586c69c reply state 00000000336a5c2f transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.638663:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.638670:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391434.638673:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391434.638676:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391434.638853:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+45:11210:x1877361169571584:12345-192.168.202.28@tcp:36:truncate.0 Request processed in 739us (1590us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1790391434.638862:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 64 00000020:00080000:1.0:1790391434.638868:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790391434.799310:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391434.799440:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169571712 00000100:00100000:3.0:1790391434.799455:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169571712 00000100:00100000:3.0:1790391434.799530:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:3.0:1790391434.799541:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+45:11224:x1877361169571712:12345-192.168.202.28@tcp:101:stat.0 00010000:00010000:3.0:1790391434.799603:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391434.799626:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e143b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b018c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799686:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1442 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799711:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799723:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799735:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1449 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799742:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799749:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799820:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799830:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799836:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391434.799927:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1790391434.799937:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391434.799960:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799972:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799981:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1442 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.799987:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1442 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800002:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1442 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800008:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391434.800012:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1442 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800019:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1442 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800030:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391434.800033:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391434.800037:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1442 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800045:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1442 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800057:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1449 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800073:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1449 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800078:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1449 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800083:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391434.800085:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1449 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800090:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1449 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800097:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e5283a48900) 00010000:00010000:3.0:1790391434.800100:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391434.800103:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1449 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800107:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1449 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800135:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e143b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b018c expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800146:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b018c expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.800153:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391434.800155:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391434.800163:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763da00, rc 0) 00000100:00100000:3.0:1790391434.800232:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+46:11224:x1877361169571712:12345-192.168.202.28@tcp:101:stat.0 Request processed in 693us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391434.800240:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:0.0:1790391434.897853:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391434.898134:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169571968 00000100:00100000:2.0:1790391434.898153:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169571968 00000100:00100000:2.0:1790391434.898252:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:2.0:1790391434.898265:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+46:11234:x1877361169571968:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391434.898294:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391434.898321:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0193 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391434.898454:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1790391434.898596:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1457 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0193 expref: 48 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.898634:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:2.0:1790391434.898638:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391434.898644:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0193 expref: 48 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.898659:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d800, rc 0) 00000100:00100000:2.0:1790391434.901478:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+47:11234:x1877361169571968:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 3196us (3616us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1790391434.901506:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:3.0:1790391434.905123:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391434.905355:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169572224 00000100:00100000:1.0:1790391434.905370:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169572224 00000100:00100000:1.0:1790391434.905443:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:1.0:1790391434.905458:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+47:11234:x1877361169572224:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391434.905937:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+48:11234:x1877361169572224:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 484us (824us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1790391434.905946:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:3.0:1790391434.961461:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391434.961804:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169572480 00000100:00100000:0.0:1790391434.961815:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169572480 00000100:00100000:0.0:1790391434.961873:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:0.0:1790391434.961911:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+48:11240:x1877361169572480:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:0.0:1790391434.961935:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391434.961954:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1465 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b019a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391434.962090:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391434.962106:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b018c expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391434.963383:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391434.963431:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b018c expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391434.963447:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b018c expref: 49 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391434.963463:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186440960:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391434.963859:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391434.967234:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391434.967301:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169572608 00000100:00100000:1.0:1790391434.967321:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169572608 00010000:00010000:1.0:1790391434.967364:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b018c expref: 50 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391434.967415:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:1.0:1790391434.967425:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+50:2384:x1877361169572608:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391434.967439:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391434.967457:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b018c expref: 50 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.967471:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b018c expref: 50 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.967492:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391434.967497:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.967508:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.967516:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.967535:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391434.967586:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+50:2384:x1877361169572608:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 162us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391434.967593:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 57 00010000:00010000:0.0:1790391434.968489:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b018c expref: 49 pid: 6513 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391434.968517:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186440960:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391434.968537:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391434.968545:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391434.968564:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391434.968709:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1790391434.968851:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1465 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b019a expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391434.968867:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b019a expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391434.968875:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:0.0:1790391434.968933:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790391434.968936:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee400, rc 0) 00000100:00100000:0.0:1790391434.968978:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+49:11240:x1877361169572480:12345-192.168.202.28@tcp:101:bash.0 Request processed in 7069us (7527us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1790391434.968985:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:2.0:1790391434.972730:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391434.973006:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169572864 00000100:00100000:1.0:1790391434.973018:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169572864 00000100:00100000:1.0:1790391434.973096:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:1.0:1790391434.973106:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+49:11240:x1877361169572864:12345-192.168.202.28@tcp:36:bash.0 00010000:00010000:1.0:1790391434.973367:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.973385:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.973396:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391434.973437:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1790391434.973459:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b23c5bd3 reply state 00000000d5ce2740 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.973483:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.973491:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391434.973493:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391434.973497:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391434.973592:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+52:11240:x1877361169572864:12345-192.168.202.28@tcp:36:bash.0 Request processed in 487us (870us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1790391434.973599:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 68 00000020:00080000:1.0:1790391434.973604:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790391434.981977:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391434.982118:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169572992 00000100:00100000:3.0:1790391434.982128:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169572992 00000100:00100000:3.0:1790391434.982187:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 69 00000100:00100000:3.0:1790391434.982197:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+52:11240:x1877361169572992:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:3.0:1790391434.982220:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391434.982243:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e1481 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.982342:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.982358:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b019a expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.982367:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.982403:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b019a expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391434.982417:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b019a expref: 53 pid: 6512 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391434.982449:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186441088:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391434.982750:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aef00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391434.986017:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391434.986133:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186441088:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391434.986161:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391434.986281:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169573120 00000100:00100000:1.0:1790391434.986289:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169573120 00010000:00010000:1.0:1790391434.986336:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b019a expref: 54 pid: 6512 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391434.986392:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00100000:1.0:1790391434.986403:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+54:2383:x1877361169573120:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391434.986418:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391434.986424:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b019a expref: 54 pid: 6512 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.986436:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b019a expref: 54 pid: 6512 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.986456:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e146c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b019a expref: 54 pid: 6512 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.986928:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391434.986934:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.986945:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.986952:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391434.986981:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391434.987050:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+53:2383:x1877361169573120:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 648us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391434.987058:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 58 00010000:00010000:2.0:1790391434.987158:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.987166:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391434.987219:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790391434.987223:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391434.987246:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.987276:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e1481 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01a1 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.987313:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01a1 expref: 52 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391434.987321:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:2.0:1790391434.987324:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391434.987326:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c200, rc 0) 00000100:00100000:2.0:1790391434.987353:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+52:11240:x1877361169572992:12345-192.168.202.28@tcp:101:bash.0 Request processed in 5158us (5386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391434.987360:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 69 00000100:00100000:2.0:1790391434.990672:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391434.990798:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169573376 00000100:00100000:3.0:1790391434.990809:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169573376 00000100:00100000:3.0:1790391434.990866:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:3.0:1790391434.990915:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+52:11240:x1877361169573376:12345-192.168.202.28@tcp:35:bash.0 00000100:00100000:3.0:1790391434.991145:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+53:11240:x1877361169573376:12345-192.168.202.28@tcp:35:bash.0 Request processed in 270us (483us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1790391434.991156:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:3.0:1790391435.078387:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391435.078511:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169573632 00000100:00100000:1.0:1790391435.078536:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169573632 00000100:00100000:1.0:1790391435.078609:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 70 00000100:00100000:1.0:1790391435.078619:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+53:11250:x1877361169573632:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391435.078643:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391435.078665:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e148f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391435.078779:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790391435.078919:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e148f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01a8 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.078933:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:1.0:1790391435.078935:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391435.078940:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e148f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01a8 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.078954:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086c00, rc 0) 00000100:00100000:1.0:1790391435.079040:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+54:11250:x1877361169573632:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 422us (662us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1790391435.079048:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 70 00000100:00100000:2.0:1790391435.084110:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391435.084240:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169573760 00000100:00100000:0.0:1790391435.084250:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169573760 00000100:00100000:0.0:1790391435.084311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 71 00000100:00100000:0.0:1790391435.084322:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+54:11250:x1877361169573760:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:0.0:1790391435.084411:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e149d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084429:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e149d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084440:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e149d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084474:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084482:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084489:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084586:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084596:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084603:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391435.084653:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084666:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e149d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084672:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e149d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084679:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e149d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084685:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391435.084689:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e149d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084703:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e149d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084715:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:0.0:1790391435.084718:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391435.084723:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e149d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084730:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e149d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084744:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084749:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084756:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084761:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefa00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391435.084763:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084768:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084775:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e5283a48900) 00010000:00010000:0.0:1790391435.084777:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391435.084780:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084795:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084805:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084810:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084815:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084820:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391435.084822:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084827:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084835:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:0.0:1790391435.084838:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391435.084841:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.084846:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e14ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391435.084938:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+54:11250:x1877361169573760:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 616us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391435.084946:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 71 00000100:00100000:0.0:1790391435.089761:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391435.090007:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169574016 00000100:00100000:3.0:1790391435.090017:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169574016 00000100:00100000:3.0:1790391435.090078:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:3.0:1790391435.090088:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+54:11250:x1877361169574016:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:3.0:1790391435.090315:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+55:11250:x1877361169574016:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 228us (562us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1790391435.090323:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:1.0:1790391435.132839:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391435.133049:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169574272 00000100:00100000:2.0:1790391435.133060:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169574272 00000100:00100000:2.0:1790391435.133123:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 72 00000100:00100000:2.0:1790391435.133135:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+55:11253:x1877361169574272:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391435.133161:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391435.133182:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e14b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133255:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133269:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133280:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133309:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e14c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133317:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e14c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133323:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e14c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133441:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e14c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133451:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e14c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133459:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e14c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391435.133467:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790391435.133543:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133551:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133558:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133563:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309cc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391435.133579:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133599:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133611:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391435.133614:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391435.133619:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133625:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133639:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e14c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133646:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e14c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133652:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e14c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133657:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309dc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391435.133660:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e14c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133665:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e14c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133672:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e5283a48900) 00010000:00010000:2.0:1790391435.133674:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391435.133677:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e14c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133692:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e14c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133730:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e14b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01af expref: 58 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133744:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e14c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01af expref: 57 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.133752:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:2.0:1790391435.133754:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391435.133757:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ce00, rc 0) 00000100:00100000:2.0:1790391435.133825:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+57:11253:x1877361169574272:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 691us (995us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790391435.133832:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 72 00000100:00100000:2.0:1790391435.139976:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391435.140019:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391435.140089:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169574400 00000100:00100000:0.0:1790391435.140099:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169574400 00000100:00100000:0.0:1790391435.140148:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 73 00000100:00100000:0.0:1790391435.140156:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+57:11253:x1877361169574400:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:0.0:1790391435.140215:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.140230:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.140238:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.140267:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.140272:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.140277:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.140280:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefa00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391435.140284:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.140291:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.140302:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:0.0:1790391435.140305:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391435.140327:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.140333:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e14d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391435.140426:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+57:11253:x1877361169574400:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 269us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391435.140434:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 73 00000100:00100000:1.0:1790391435.140494:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169574528 00000100:00100000:1.0:1790391435.140498:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169574528 00000100:00100000:1.0:1790391435.140541:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:1.0:1790391435.140549:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+57:2384:x1877361169574528:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391435.140559:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391435.140582:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e14c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01af expref: 57 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.140597:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391435.140599:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391435.140615:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+56:2384:x1877361169574528:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 69us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391435.140619:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:0.0:1790391435.143615:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391435.143645:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391435.143664:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391435.143755:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169574656 00000100:00100000:1.0:1790391435.143763:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169574656 00000100:00100000:1.0:1790391435.143803:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 381 00000100:00100000:1.0:1790391435.143809:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2382:x1877361169574656:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391435.143908:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169575168 00000100:00100000:2.0:1790391435.143911:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169575168 00000100:00100000:2.0:1790391435.143944:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 279 00000100:00100000:2.0:1790391435.143949:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2382:x1877361169575168:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391435.144019:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169574912 00000100:00100000:3.0:1790391435.144027:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169574912 00000100:00100000:3.0:1790391435.144058:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 132 00000100:00080000:0.0:1790391435.144058:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391435.144063:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391435.144067:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2382:x1877361169574912:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391435.144190:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2382:x1877361169574656:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 378us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391435.144197:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 381 00000100:00100000:1.0:1790391435.144250:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391435.144342:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391435.144361:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169574784 00000100:00100000:1.0:1790391435.144365:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169574784 00000100:00080000:1.0:1790391435.144381:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391435.144400:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169575040 00000100:00100000:1.0:1790391435.144404:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169575040 00000100:00080000:1.0:1790391435.144416:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391435.144426:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 280 00000100:00100000:1.0:1790391435.144433:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169574784:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391435.144464:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169574784:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391435.144471:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 280 00000100:00100000:1.0:1790391435.144518:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 281 00000100:00100000:1.0:1790391435.144524:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2382:x1877361169575040:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391435.144549:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2382:x1877361169575040:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 25us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391435.144555:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 281 00000100:00100000:2.0:1790391435.145694:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2382:x1877361169575168:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 1736us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391435.145705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 279 00000100:00100000:3.0:1790391435.146080:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2382:x1877361169574912:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 2011us (2428us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391435.146102:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 132 00000100:00100000:2.0:1790391435.146115:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391435.146160:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169575424 00000100:00100000:1.0:1790391435.146168:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169575424 00000100:00100000:1.0:1790391435.146204:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:1.0:1790391435.146212:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+56:11253:x1877361169575424:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391435.146413:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+57:11253:x1877361169575424:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 200us (296us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1790391435.146420:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 17 00010000:00010000:2.0:1790391435.208310:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391435.272348:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186441216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391435.272435:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391435.272750:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186441216 00000100:00100000:3.0:1790391435.272761:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186441216 00000100:00100000:3.0:1790391435.272823:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790391435.272834:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186441216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391435.272864:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391435.276171:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391435.276195:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186441472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391435.276366:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391435.276492:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186441472 00000100:00100000:2.0:1790391435.276501:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186441472 00000100:00100000:2.0:1790391435.276632:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790391435.276655:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186441472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391435.276700:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790391435.276775:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186441472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391435.276782:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790391435.276911:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186441472:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1790391435.276962:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391435.276998:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186441344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391435.277028:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391435.277070:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186441344 00000100:00100000:2.0:1790391435.277074:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186441344 00000100:00100000:2.0:1790391435.277104:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790391435.277110:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186441344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391435.277125:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391435.277158:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186441344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391435.277164:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1790391435.277176:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391435.277197:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186441344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391435.283631:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186441216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10789us (11185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391435.283646:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790391435.289213:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186441216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391435.299169:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391435.299462:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169575680 00000100:00100000:1.0:1790391435.299480:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169575680 00000100:00100000:1.0:1790391435.299591:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 74 00000100:00100000:1.0:1790391435.299601:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+57:11271:x1877361169575680:12345-192.168.202.28@tcp:101:cat.0 00010000:00010000:1.0:1790391435.299624:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391435.299644:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e14dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01b6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.299747:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e14e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.299762:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e14e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.299774:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e14e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391435.299793:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790391435.299943:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e14dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01b6 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.299963:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e14e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01b6 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.299972:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391435.299975:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790391435.299979:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087200, rc 0) 00000100:00100000:1.0:1790391435.300058:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:11271:x1877361169575680:12345-192.168.202.28@tcp:101:cat.0 Request processed in 458us (901us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1790391435.300065:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 74 00000100:00100000:2.0:1790391435.326390:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391435.326654:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169575808 00000100:00100000:1.0:1790391435.326663:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169575808 00000100:00100000:1.0:1790391435.326783:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 75 00000100:00100000:1.0:1790391435.326792:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:11272:x1877361169575808:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391435.326816:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391435.326835:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e14f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01bd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.326925:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e14f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.326939:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e14f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391435.326967:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e14f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391435.327141:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790391435.327145:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391435.327164:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e14f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.327186:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e14f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01bd expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.327199:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e14f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01bd expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.327206:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391435.327208:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391435.327211:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087800, rc 0) 00000100:00100000:2.0:1790391435.327264:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:11272:x1877361169575808:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 473us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391435.327271:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 75 00000100:00100000:0.0:1790391435.340798:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391435.340903:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169576192 00000100:00100000:2.0:1790391435.340913:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169576192 00000100:00100000:2.0:1790391435.340972:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:2.0:1790391435.340983:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:11272:x1877361169576192:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:2.0:1790391435.341251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:11272:x1877361169576192:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 269us (462us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1790391435.341259:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:3.0:1790391435.343520:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391435.343774:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169576320 00000100:00100000:2.0:1790391435.343785:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169576320 00000100:00100000:2.0:1790391435.343853:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:2.0:1790391435.343908:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:11272:x1877361169576320:12345-192.168.202.28@tcp:103:lfs.0 00010000:00010000:2.0:1790391435.343937:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790391435.343962:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1488 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01a1 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.343985:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e14e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01b6 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.344008:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1385 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b015b expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.344016:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:2.0:1790391435.344021:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391435.344088:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+58:11272:x1877361169576320:12345-192.168.202.28@tcp:103:lfs.0 Request processed in 210us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391435.344096:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:3.0:1790391435.347659:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391435.347847:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169576448 00000100:00100000:2.0:1790391435.347856:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169576448 00000100:00100000:2.0:1790391435.347955:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 76 00000100:00100000:2.0:1790391435.347965:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+58:11272:x1877361169576448:12345-192.168.202.28@tcp:58:lfs.0 00010000:00010000:2.0:1790391435.348119:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.348139:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391435.348152:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391435.348771:0:10091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391435.349175:0:10091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1790391435.349271:0:10091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1790391435.349742:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+58:11272:x1877361169576448:12345-192.168.202.28@tcp:58:lfs.0 Request processed in 1773us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391435.349752:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 76 00000100:00100000:3.0:1790391435.372442:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391435.373070:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169576576 00000100:00100000:0.0:1790391435.373083:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169576576 00000100:00100000:0.0:1790391435.373149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 77 00000100:00100000:0.0:1790391435.373161:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+58:11274:x1877361169576576:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391435.373181:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391435.373201:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1506 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01c4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.373265:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e150d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.375837:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e150d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.375851:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e150d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.375874:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.375897:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.375904:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.375997:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376006:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376014:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391435.376061:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790391435.376065:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391435.376085:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376097:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376122:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e150d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376128:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e150d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376134:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e150d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376139:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391435.376143:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e150d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376150:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e150d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376162:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:0.0:1790391435.376165:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391435.376169:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e150d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376175:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e150d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376187:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376192:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1514 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376197:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376207:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391435.376209:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376215:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1514 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376222:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e5283a48900) 00010000:00010000:0.0:1790391435.376224:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391435.376227:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1514 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376233:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1514 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376270:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1506 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01c4 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376509:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01c4 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391435.376519:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:0.0:1790391435.376521:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391435.376524:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefa00, rc 0) 00000100:00100000:0.0:1790391435.376607:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:11274:x1877361169576576:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 3447us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391435.376616:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 77 00010000:00010000:1.0:1790391436.235076:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391436.256227:0:14203:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391436.256236:0:14203:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391436.256271:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790391436.256283:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1790391436.360832:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391436.360841:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391436.360899:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790391436.360908:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391436.361060:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186441600:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391436.361154:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51838986c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391436.363930:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186441600:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790391436.380972:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391436.381436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169576704 00000100:00100000:1.0:1790391436.381446:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169576704 00000100:00100000:1.0:1790391436.381527:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 78 00000100:00100000:1.0:1790391436.381538:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:11286:x1877361169576704:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790391436.381567:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790391436.381694:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:11286:x1877361169576704:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 158us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391436.381701:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 78 00000100:00080000:3.0:1790391436.383855:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391436.389258:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391436.389305:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169576832 00000100:00100000:3.0:1790391436.389315:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169576832 00000100:00100000:3.0:1790391436.389372:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 79 00000100:00100000:3.0:1790391436.389384:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:11286:x1877361169576832:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790391436.389458:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1522 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389477:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1522 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389489:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1522 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389542:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1529 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389551:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1529 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389558:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1529 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389585:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389594:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389600:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391436.389647:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790391436.389652:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391436.389668:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389680:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1522 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389687:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1522 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389694:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1522 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389709:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.389713:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1522 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389721:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1522 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389733:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:3.0:1790391436.389737:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391436.389742:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1522 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389749:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1522 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389763:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1529 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389768:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1529 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389774:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1529 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389778:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.389781:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1529 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389786:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1529 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389804:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9e51821bab00) 00010000:00010000:3.0:1790391436.389806:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391436.389809:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1529 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389814:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1529 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389843:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389849:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389854:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389860:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.389862:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389868:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389899:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391436.389902:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391436.389905:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.389911:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1530 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391436.390296:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:11286:x1877361169576832:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 Request processed in 911us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391436.390304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 79 00000001:00080000:0.0:1790391436.390577:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:0.0:1790391436.390638:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1790391436.390657:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e52892fc180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1790391436.390661:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5182314400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e52892fc480 00000020:00080000:0.0:1790391436.390664:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5182314d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5182f3de00 00000100:00100000:0.0:1790391436.390793:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186441728:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790391436.390842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391436.390929:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186441728 00000100:00100000:0.0:1790391436.390936:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186441728 00010000:00010000:3.0:1790391436.391140:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391150:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391155:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391161:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.391165:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391172:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391183:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e52b9b6cf00) 00010000:00010000:3.0:1790391436.391186:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391436.391189:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391196:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e12c1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391213:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391230:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391236:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391241:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.391244:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391250:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391258:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391436.391260:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391436.391263:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391268:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e12c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391281:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391286:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391291:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391296:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.391304:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391311:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391318:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e5283a48900) 00010000:00010000:3.0:1790391436.391320:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391436.391323:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391329:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1307 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391343:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391349:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391356:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391361:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.391364:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391370:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391379:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391436.391381:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391436.391391:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391396:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1411 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391408:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391413:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391419:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391424:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.391427:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391433:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391441:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391436.391443:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391436.391446:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391451:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1434 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391461:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391466:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391478:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391483:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.391485:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391491:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391499:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391436.391501:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391436.391503:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.391510:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e147a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790391436.393301:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1790391436.393497:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790391436.393638:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790391436.393655:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186441728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790391436.393691:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1790391436.393726:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6ab73489, atime: 0x6ab73489, ctime: 0x6ab73489, blocks: 0x8 00010000:00010000:0.0:1790391436.393734:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006de04d7e/0x2b1b7949f13e1537 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.393750:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1790391436.393754:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391436.393761:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006de04d7e/0x2b1b7949f13e1537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.393778:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006de04d7e/0x2b1b7949f13e1537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.393789:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006de04d7e/0x2b1b7949f13e1537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.393809:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006de04d7e/0x2b1b7949f13e1537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.393836:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391436.395346:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391436.395366:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006de04d7e/0x2b1b7949f13e1537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.395378:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391436.395383:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006de04d7e/0x2b1b7949f13e1537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.395393:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006de04d7e/0x2b1b7949f13e1537 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.395413:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006de04d7e/0x2b1b7949f13e1537 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.395421:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006de04d7e/0x2b1b7949f13e1537 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.395442:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391436.395444:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391436.395446:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391436.395958:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186441728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2304us (5110us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790391436.395968:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790391436.396084:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1790391436.397187:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e52bfa6b800/2, rc 0, transno 4294967302 00000100:00100000:3.0:1790391436.397198:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186441728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790391436.397314:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391436.397497:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169577088 00000100:00100000:3.0:1790391436.397504:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169577088 00000100:00100000:3.0:1790391436.397551:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 80 00000100:00100000:3.0:1790391436.397560:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+12:11286:x1877361169577088:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391436.397578:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391436.397596:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ca00/0x2b1b7949f13e153e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397705:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e1545 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397719:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e1545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397730:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e1545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391436.397740:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790391436.397810:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e1545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397817:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e1545 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397824:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e1545 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397829:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.397834:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e1545 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397841:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e1545 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397850:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391436.397853:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391436.397857:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e1545 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397872:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e1545 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397947:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ca00/0x2b1b7949f13e153e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01cb expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397957:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:3.0:1790391436.397959:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391436.397963:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ca00/0x2b1b7949f13e153e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01cb expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.397971:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763ca00, rc 0) 00000100:00100000:3.0:1790391436.399504:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:11286:x1877361169577088:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 1927us (2174us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1790391436.399516:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 80 00000100:00100000:1.0:1790391436.402964:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391436.403057:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169577216 00000100:00100000:3.0:1790391436.403068:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169577216 00000100:00100000:3.0:1790391436.403139:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 81 00000100:00100000:3.0:1790391436.403152:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:11286:x1877361169577216:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790391436.403190:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790391436.403324:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:11286:x1877361169577216:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 175us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391436.403331:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 81 00000100:00100000:0.0:1790391436.410511:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391436.410753:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169577472 00000100:00100000:1.0:1790391436.410764:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169577472 00000100:00100000:1.0:1790391436.410822:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 82 00000100:00100000:1.0:1790391436.410833:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:11286:x1877361169577472:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391436.410855:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391436.410859:0:10091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790391436.410917:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e14f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01bd expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.410934:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:1.0:1790391436.410940:0:10091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391436.410954:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1553 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01d2 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790391436.411443:0:10091:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1790391436.411611:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e155a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.411626:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e155a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.411636:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e155a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.411721:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1553 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d2 expref: 15 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.411737:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e155a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d2 expref: 14 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.411745:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e5283a48e00) 00010000:00010000:1.0:1790391436.411748:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391436.411750:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086000, rc 0) 00000100:00100000:1.0:1790391436.411815:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:11286:x1877361169577472:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 983us (1315us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1790391436.411833:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 82 00000100:00100000:1.0:1790391436.416430:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.416506:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169577728 00000100:00100000:0.0:1790391436.416517:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169577728 00000100:00100000:0.0:1790391436.416592:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 83 00000100:00100000:0.0:1790391436.416603:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:11286:x1877361169577728:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790391436.416665:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391436.416690:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e155a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d2 expref: 14 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416706:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e5283a48e00) 00010000:00010000:0.0:1790391436.416717:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391436.416740:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1568 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416754:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1568 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416763:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1568 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416833:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e156f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xf2662420 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416842:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e156f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf2662420 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416849:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e156f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf2662420 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416915:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1568 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416923:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1568 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416930:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1568 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416935:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391436.416940:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1568 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416948:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1568 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416957:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:0.0:1790391436.416961:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391436.416965:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1568 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.416971:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1568 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.417004:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e156f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf2662420 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.417009:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e156f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf2662420 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.417014:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e156f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf2662420 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.417019:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391436.417023:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e156f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf2662420 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.417029:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e156f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf2662420 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.417036:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xf2662420 (ffff9e5182c85d00) 00010000:00010000:0.0:1790391436.417038:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391436.417041:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e156f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf2662420 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.417047:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e156f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf2662420 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391436.417126:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:11286:x1877361169577728:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 524us (709us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391436.417133:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 83 00000100:00100000:1.0:1790391436.425268:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391436.425351:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169577856 00000100:00100000:3.0:1790391436.425362:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169577856 00000100:00100000:3.0:1790391436.425422:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 84 00000100:00100000:3.0:1790391436.425443:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:11286:x1877361169577856:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391436.425463:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391436.425486:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ca00/0x2b1b7949f13e1576 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01d9 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.425525:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.425540:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.425552:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.425662:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ca00/0x2b1b7949f13e1576 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d9 expref: 15 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.425680:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d9 expref: 14 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.425688:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:3.0:1790391436.425691:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391436.425695:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d800, rc 0) 00000100:00100000:3.0:1790391436.425777:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:11286:x1877361169577856:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 337us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391436.425785:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 84 00000100:00100000:1.0:1790391436.437056:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.447082:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169578112 00000100:00100000:0.0:1790391436.447100:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169578112 00000100:00100000:0.0:1790391436.447178:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 85 00000100:00100000:0.0:1790391436.447199:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:11286:x1877361169578112:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790391436.447290:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.447308:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.447320:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391436.447477:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1790391436.447486:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349814607806ns, next at 350814605437ns, rc = 0 00000004:00010000:0.0:1790391436.447533:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f81d26fe reply state 000000008d4009c8 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.447545:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.447554:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:0.0:1790391436.447556:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790391436.447561:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790391436.447659:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:11286:x1877361169578112:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 461us (10610us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1790391436.447667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 85 00000100:00100000:1.0:1790391436.457567:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.462699:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169578240 00000100:00100000:0.0:1790391436.462715:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169578240 00000100:00100000:0.0:1790391436.462784:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 86 00000100:00100000:0.0:1790391436.462795:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:11286:x1877361169578240:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391436.462818:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391436.462847:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e158b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01e0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.462932:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e158b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e0 expref: 17 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.462950:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e158b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e0 expref: 17 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.462973:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:0.0:1790391436.462987:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391436.462991:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef200, rc 0) 00000100:00100000:0.0:1790391436.463065:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:11286:x1877361169578240:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 271us (5506us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.463072:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 86 00000100:00100000:1.0:1790391436.468009:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.468099:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169578368 00000100:00100000:0.0:1790391436.468109:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169578368 00000100:00100000:0.0:1790391436.468172:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:0.0:1790391436.468182:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2380:x1877361169578368:12345-192.168.202.28@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1790391436.468220:0:9796:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:0.0:1790391436.468254:0:9796:0:(genops.c:1385:class_connect()) connect: client 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d, cookie 0x2b1b7949f13e1592 00002000:00100000:0.0:1790391436.468268:0:9796:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d/ffff9e5287d5c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790391436.468280:0:9796:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790391436.468363:0:9796:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790391436.468393:0:9796:0:(import.c:65:import_set_state_nolock()) ffff9e5287d58800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391436.468457:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2380:x1877361169578368:12345-192.168.202.28@tcp:8:lhsmtool_posix.0 Request processed in 275us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.468475:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:1.0:1790391436.475558:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391436.475622:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169578496 00000100:00100000:3.0:1790391436.475632:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169578496 00000100:00100000:3.0:1790391436.475709:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 34 00000100:00100000:3.0:1790391436.475734:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:0:x1877361169578496:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1790391436.475923:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1790391436.478715:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1790391436.478730:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000100:00100000:0.0:1790391436.479534:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:0:x1877361169578496:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 3796us (3979us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790391436.479547:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 34 00000100:00100000:1.0:1790391436.482407:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391436.482767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169578752 00000100:00100000:2.0:1790391436.482777:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169578752 00000100:00100000:2.0:1790391436.482834:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:2.0:1790391436.482845:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:11286:x1877361169578752:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790391436.483471:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:11286:x1877361169578752:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 625us (1071us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1790391436.483479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:1.0:1790391436.485722:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.485840:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169579008 00000100:00100000:0.0:1790391436.485849:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169579008 00000100:00100000:0.0:1790391436.486198:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 87 00000100:00100000:0.0:1790391436.486209:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:11286:x1877361169579008:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790391436.486321:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:11286:x1877361169579008:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 114us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.486329:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 87 00000100:00100000:1.0:1790391436.488755:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.489212:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169579136 00000100:00100000:0.0:1790391436.489223:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169579136 00000100:00100000:0.0:1790391436.489320:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 88 00000100:00100000:0.0:1790391436.489333:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:11286:x1877361169579136:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391436.489355:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391436.489377:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1599 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01e7 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.489477:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e15a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.489492:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e15a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.489504:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e15a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391436.489572:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391436.489592:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e15a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.489619:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1599 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e7 expref: 20 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.489636:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e15a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e7 expref: 19 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.489645:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:0.0:1790391436.489648:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790391436.489652:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee600, rc 0) 00000100:00100000:0.0:1790391436.489716:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:11286:x1877361169579136:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 386us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.489723:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 88 00000100:00100000:2.0:1790391436.498641:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.498730:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169579264 00000100:00100000:0.0:1790391436.498741:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169579264 00000100:00100000:0.0:1790391436.498806:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:0.0:1790391436.498817:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169579264:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391436.498836:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391436.498860:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e15a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01ee expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391436.498929:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab7348d, blocks: 0x0 00010000:00010000:0.0:1790391436.498951:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1790391436.498970:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391436.499180:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e15a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01ee expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.499205:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e15a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01ee expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.499220:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefe00, rc 0) 00000100:00100000:0.0:1790391436.499281:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169579264:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 465us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.499288:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:1.0:1790391436.504217:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.504454:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169579520 00000100:00100000:0.0:1790391436.504466:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169579520 00000100:00100000:0.0:1790391436.504532:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 89 00000100:00100000:0.0:1790391436.504543:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:11286:x1877361169579520:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790391436.504660:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:11286:x1877361169579520:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 118us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.504668:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 89 00000100:00100000:1.0:1790391436.509752:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391436.509929:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169579648 00000100:00100000:2.0:1790391436.509939:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169579648 00000100:00100000:2.0:1790391436.509995:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 36 00000100:00100000:2.0:1790391436.510005:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:11286:x1877361169579648:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391436.510022:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391436.510041:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01f5 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.510074:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e15a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01ee expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.510101:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391436.510106:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391436.510112:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.510276:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e15a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01ee expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.510290:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e15a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01ee expref: 7 pid: 8428 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391436.510304:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1877361186441856:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391436.510399:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391436.523800:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391436.523999:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1877361186441856:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391436.524034:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.524057:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c600, rc 0) 00000100:00100000:2.0:1790391436.524124:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:11286:x1877361169579648:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 14120us (14386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391436.524133:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 36 00000100:00100000:1.0:1790391436.528989:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169579776 00000100:00100000:1.0:1790391436.529005:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169579776 00010000:00010000:1.0:1790391436.529059:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e15a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01ee expref: 7 pid: 8428 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391436.529123:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:1.0:1790391436.529134:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169579776:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391436.529152:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391436.529185:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e15a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01ee expref: 7 pid: 8428 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.529210:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e15a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01ee expref: 7 pid: 8428 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.529254:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e15a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01ee expref: 7 pid: 8428 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.529270:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391436.529275:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391436.529284:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.529295:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.529334:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391436.529348:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1877361186441984:192.168.202.28@tcp:105: 00000100:00100000:1.0:1790391436.529448:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183898540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391436.538463:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1877361186441984:192.168.202.28@tcp:105: 00010000:00010000:1.0:1790391436.538505:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391436.538583:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169579776:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 9449us (14791us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391436.538594:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:2.0:1790391436.540543:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.540650:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169579904 00000100:00100000:0.0:1790391436.540660:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169579904 00002000:00100000:0.0:1790391436.540716:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9e518382ed80 x1877361169579904/t0(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:302/0 lens 504/0 e 0 to 0 dl 1790391447 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391436.540728:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e518382ed80 with x1877361169579904 ext(0->8) 00002000:00010000:0.0:1790391436.540733:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e518382ed80 00000100:00100000:0.0:1790391436.540765:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:0.0:1790391436.540774:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169579904:12345-192.168.202.28@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790391436.542570:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169579904:12345-192.168.202.28@tcp:4:lhsmtool_posix.0 Request processed in 1788us (2027us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790391436.542582:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00002000:00100000:0.0:1790391436.542593:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9e518382ed80 x1877361169579904/t4294967303(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:302/0 lens 504/448 e 0 to 0 dl 1790391447 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391436.542602:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e518382ed80 with x1877361169579904 ext(0->8) 00002000:00010000:0.0:1790391436.542607:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e518382ed80 00000100:00100000:0.0:1790391436.565144:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391436.565248:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169580032 00000100:00100000:2.0:1790391436.565260:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169580032 00000100:00100000:2.0:1790391436.565340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 90 00000100:00100000:2.0:1790391436.565351:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:11286:x1877361169580032:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790391436.569380:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1790391436.569398:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1790391436.569422:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1790391436.569574:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:11286:x1877361169580032:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 Request processed in 4220us (4437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391436.569584:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 90 00000020:00080000:1.0:1790391436.569769:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1790391436.569781:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1790391436.570081:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.570093:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.570100:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.570106:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391436.570111:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.570118:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.570134:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:0.0:1790391436.570137:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790391436.570142:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.570166:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e1584 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391436.570412:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186442112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790391436.570469:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391436.572369:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186442112 00000100:00100000:3.0:1790391436.572550:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186442112 00000100:00100000:3.0:1790391436.572612:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391436.572622:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186442112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790391436.572754:0:10505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790391436.572769:0:10505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790391437 00002000:00010000:3.0:1790391436.572772:0:10505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790391436.572774:0:10505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790391437 -> 1790391437 00002000:00010000:3.0:1790391436.572777:0:10505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1790391436.572867:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186442112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 246us (2397us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790391436.572901:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1790391436.573317:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5288345180/2, rc 0, transno 4294967304 00000100:00100000:2.0:1790391436.573326:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186442112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790391436.576608:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.587025:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169580160 00000100:00100000:0.0:1790391436.587042:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169580160 00000100:00100000:0.0:1790391436.587120:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 38 00000100:00100000:0.0:1790391436.587132:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2381:x1877361169580160:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790391436.595655:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1790391436.595668:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1790391436.595945:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2381:x1877361169580160:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 Request processed in 8810us (19341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.595958:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 38 00000100:00100000:2.0:1790391436.603500:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.603666:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169580416 00000100:00100000:0.0:1790391436.603677:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169580416 00000100:00100000:0.0:1790391436.603747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 91 00000100:00100000:0.0:1790391436.603757:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:11286:x1877361169580416:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790391436.603814:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391436.603853:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e15a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e7 expref: 14 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.603871:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:0.0:1790391436.603927:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391436.603958:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.603971:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.604010:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391436.604152:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d982fc5a reply state 000000003a0909eb transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.604168:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.604175:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:0.0:1790391436.604178:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790391436.604181:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790391436.604299:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:11286:x1877361169580416:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 543us (809us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1790391436.604307:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 91 00000100:00100000:1.0:1790391436.625479:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391436.625591:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169580544 00000100:00100000:2.0:1790391436.625602:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169580544 00000100:00100000:2.0:1790391436.625664:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:2.0:1790391436.625675:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169580544:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790391436.626244:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790391436.626249:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790391437 -> 1790391435 00002000:00010000:2.0:1790391436.626252:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790391433 00002000:00010000:2.0:1790391436.626254:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790391437 -> 1790391435 00002000:00010000:2.0:1790391436.626256:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1790391436.626317:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169580544:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 643us (858us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790391436.626325:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:3.0:1790391436.631232:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.631608:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169580800 00000100:00100000:0.0:1790391436.631617:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169580800 00000100:00100000:0.0:1790391436.631675:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 92 00000100:00100000:0.0:1790391436.631685:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:11286:x1877361169580800:12345-192.168.202.28@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790391436.631749:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.632180:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d9 expref: 15 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.632189:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.632224:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d9 expref: 15 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.632253:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d9 expref: 15 pid: 10091 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391436.632269:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186442240:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391436.632360:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822dfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391436.636156:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.636194:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169580928 00000100:00100000:0.0:1790391436.636204:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169580928 00010000:00010000:0.0:1790391436.636245:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d9 expref: 16 pid: 10091 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391436.636280:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:0.0:1790391436.636289:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:2383:x1877361169580928:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391436.636318:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391436.636325:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d9 expref: 16 pid: 10091 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.636339:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d9 expref: 16 pid: 10091 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.636364:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:0.0:1790391436.636370:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.636381:0:10388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.636409:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.636431:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391436.636483:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:2383:x1877361169580928:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 194us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.636490:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 60 00010000:00010000:0.0:1790391436.636545:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e157d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01d9 expref: 15 pid: 10091 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391436.636576:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186442240:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391436.636595:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.636604:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.636609:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.638707:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.638724:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.638732:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.638738:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391436.639168:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.639179:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.639195:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:0.0:1790391436.639198:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790391436.639203:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.639210:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391436.640413:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:11286:x1877361169580800:12345-192.168.202.28@tcp:55:lhsmtool_posix.0 Request processed in 7610us (8071us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790391436.640426:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 92 00000100:00100000:0.0:1790391436.648145:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391436.648309:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169581056 00000100:00100000:1.0:1790391436.648320:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169581056 00000100:00100000:1.0:1790391436.648383:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:1.0:1790391436.648395:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2381:x1877361169581056:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790391436.648839:0:9796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.648861:0:9796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.648869:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790391436.648874:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391436.649005:0:9796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.649045:0:9796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.649059:0:9796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 7 pid: 8429 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391436.649074:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9796:1877361186442368:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391436.649204:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183898540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391436.652663:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.652775:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9796:1877361186442368:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391436.652802:0:9796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391436.653039:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169581184 00000100:00100000:2.0:1790391436.653048:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169581184 00010000:00010000:2.0:1790391436.653086:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 8 pid: 8429 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391436.653139:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:2.0:1790391436.653149:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169581184:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391436.653164:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391436.653186:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 8 pid: 8429 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.653198:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 8 pid: 8429 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.653223:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000676c8e64/0x2b1b7949f13e15ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01f5 expref: 8 pid: 8429 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.653239:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391436.653243:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391436.653249:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.653258:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.653287:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391436.653349:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169581184:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 201us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391436.653357:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 61 00010000:00010000:0.0:1790391436.653481:0:9796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.653490:0:9796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.653511:0:9796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.653527:0:9796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.653536:0:9796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.653542:0:9796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086c00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391436.653546:0:9796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.653566:0:9796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.653578:0:9796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.653586:0:9796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f08752/0x2b1b7949f13e15c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391436.653631:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2381:x1877361169581056:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 Request processed in 5239us (5497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.653639:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:2.0:1790391436.657001:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.657093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169581440 00000100:00100000:0.0:1790391436.657102:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169581440 00000100:00100000:0.0:1790391436.657157:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 93 00000100:00100000:0.0:1790391436.657179:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:11286:x1877361169581440:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790391436.657255:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.657272:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b017e expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.657281:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.657315:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b017e expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.657328:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b017e expref: 14 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391436.657343:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186442496:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391436.657434:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822dfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391436.661047:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186442496:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391436.661077:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391436.663572:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.663836:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169581568 00000100:00100000:0.0:1790391436.663846:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169581568 00010000:00010000:0.0:1790391436.663911:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b017e expref: 15 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391436.663944:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 62 00000100:00100000:0.0:1790391436.663965:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:2384:x1877361169581568:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391436.663992:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391436.663999:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b017e expref: 15 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.664013:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b017e expref: 15 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.664036:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e140a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b017e expref: 15 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.664050:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:0.0:1790391436.664056:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.664066:0:10388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.664074:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.664113:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391436.664264:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:2384:x1877361169581568:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 298us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.664271:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 62 00010000:00010000:2.0:1790391436.664445:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.664454:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.664630:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.664642:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e158b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e0 expref: 14 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.664651:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.664680:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e158b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e0 expref: 14 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.664694:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e158b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e0 expref: 14 pid: 10091 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391436.664707:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186442624:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391436.664756:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295584780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391436.681020:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391436.681103:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169581696 00000100:00100000:0.0:1790391436.681113:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169581696 00010000:00010000:0.0:1790391436.681157:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e158b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e0 expref: 15 pid: 10091 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391436.681218:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:0.0:1790391436.681227:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:2384:x1877361169581696:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391436.681241:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391436.681247:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e158b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e0 expref: 15 pid: 10091 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.681259:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e158b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e0 expref: 15 pid: 10091 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.681279:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:0.0:1790391436.681285:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.681294:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.681302:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.681321:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391436.681377:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:2384:x1877361169581696:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 151us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.681384:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 63 00010000:00010000:2.0:1790391436.681541:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e158b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01e0 expref: 14 pid: 10091 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391436.681566:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186442624:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391436.681596:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.681607:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391436.681612:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391436.681718:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1790391436.681836:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1790391436.681873:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1790391436.682037:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1877361186442752:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790391436.682088:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391436.682117:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f223c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391436.682718:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186442752 00000100:00100000:0.0:1790391436.682726:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186442752 00000100:00100000:0.0:1790391436.682771:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790391436.682781:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1877361186442752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790391436.682912:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1877361186442752:12345-0@lo:1000:mdt00_002.0 Request processed in 133us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391436.682920:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790391436.683016:0:6514:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1790391436.683022:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5288345180, transno 4294967304 00000100:00100000:1.0:1790391436.683045:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1877361186442752:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1790391436.683182:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1790391436.683234:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1877361186442880:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790391436.683269:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391436.683300:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528968c480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391436.683726:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186442880 00000100:00100000:0.0:1790391436.683732:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186442880 00000100:00100000:0.0:1790391436.683771:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790391436.683779:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1877361186442880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790391436.683942:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1877361186442880:12345-0@lo:1000:mdt00_002.0 Request processed in 164us (672us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790391436.683950:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790391436.684133:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1877361186442880:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1790391436.684169:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684178:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684185:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684201:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.684206:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684215:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684230:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:3.0:1790391436.684232:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391436.684237:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684243:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e15d1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684273:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684279:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684285:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684289:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309cc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.684292:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684298:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684316:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391436.684318:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391436.684322:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684327:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e14ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684349:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684362:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01c4 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684370:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684395:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01c4 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.684408:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01c4 expref: 17 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391436.684419:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186443008:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391436.684503:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183880c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391436.687718:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186443008:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391436.687749:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391436.692080:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391436.698043:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169581824 00000100:00100000:1.0:1790391436.698061:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169581824 00010000:00010000:1.0:1790391436.698126:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01c4 expref: 18 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391436.698166:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:1.0:1790391436.698176:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:2383:x1877361169581824:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391436.698191:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391436.698197:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01c4 expref: 18 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.698211:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01c4 expref: 18 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.698234:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e151b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01c4 expref: 18 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.698251:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:1.0:1790391436.698270:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.698280:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.698288:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.698324:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391436.698394:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:2383:x1877361169581824:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 219us (6325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391436.698402:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 64 00010000:00010000:3.0:1790391436.698595:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698615:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698628:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698635:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698641:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698646:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.698650:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698658:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698667:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391436.698670:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391436.698674:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698680:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15d8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698691:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698697:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698709:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698713:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391436.698716:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698722:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698730:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6cd00) 00010000:00010000:3.0:1790391436.698733:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391436.698736:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391436.698742:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e15ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391436.698972:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:11286:x1877361169581440:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 41793us (41981us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1790391436.698993:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 93 00000020:00080000:3.0:1790391436.698998:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790391436.701195:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391436.701204:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391436.701224:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790391436.701234:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790391436.704445:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391436.704526:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169582080 00000100:00100000:1.0:1790391436.704537:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169582080 00000100:00100000:1.0:1790391436.704611:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:1.0:1790391436.704622:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:11286:x1877361169582080:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790391436.705005:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790391436.705042:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1790391436.705079:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.705097:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.705109:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.705133:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.705141:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.705147:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391436.705160:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790391436.705254:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:11286:x1877361169582080:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 633us (819us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1790391436.705262:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000020:00080000:1.0:1790391436.705267:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790391436.705362:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391436.705370:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.705377:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391436.705382:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.705390:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.705405:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:0.0:1790391436.705409:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790391436.705414:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.705421:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e15df lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391436.705434:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391436.705443:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391436.705444:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391437.257176:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391437.322396:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391437.322445:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186443136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391437.322540:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391437.322719:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186443136 00000100:00100000:1.0:1790391437.322728:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186443136 00000100:00100000:1.0:1790391437.322779:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790391437.322788:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186443136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391437.322835:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1790391437.322904:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186443136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391437.322912:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790391437.323396:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186443136:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1790391438.226323:0:14256:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391438.226333:0:14256:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391438.226369:0:14256:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790391438.226376:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790391438.283606:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391438.379353:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.382243:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169582336 00000100:00100000:3.0:1790391438.382259:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169582336 00000100:00100000:3.0:1790391438.382351:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 94 00000100:00100000:3.0:1790391438.382361:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:11304:x1877361169582336:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:3.0:1790391438.382385:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391438.382440:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b01fc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.382552:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ca00/0x2b1b7949f13e15ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.382567:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ca00/0x2b1b7949f13e15ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.382578:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ca00/0x2b1b7949f13e15ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391438.382589:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790391438.382694:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e15e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01fc expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.382711:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ca00/0x2b1b7949f13e15ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01fc expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.382720:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391438.382724:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790391438.382727:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763ca00, rc 0) 00000100:00100000:3.0:1790391438.382790:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:11304:x1877361169582336:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 431us (3444us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1790391438.382798:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 94 00000100:00080000:2.0:1790391438.384081:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391438.387152:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391438.387315:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169582464 00000100:00100000:2.0:1790391438.387325:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169582464 00000100:00100000:2.0:1790391438.387383:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 95 00000100:00100000:2.0:1790391438.387393:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:11304:x1877361169582464:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:2.0:1790391438.387466:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e15fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387480:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e15fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387492:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e15fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387517:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1602 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387523:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387529:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387601:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387608:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387615:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391438.387661:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387673:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e15fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387681:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e15fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387688:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e15fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387694:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391438.387698:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e15fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387712:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e15fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387724:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391438.387726:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391438.387731:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e15fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387736:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e15fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387749:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387754:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1602 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387759:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1602 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387764:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391438.387766:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1602 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387772:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1602 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387779:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e52b9b6c700) 00010000:00010000:2.0:1790391438.387781:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391438.387784:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1602 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387799:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1602 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387814:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.387821:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.388033:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.388039:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ce00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391438.388042:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.388048:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.388056:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c000) 00010000:00010000:2.0:1790391438.388058:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391438.388061:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.388066:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1609 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391438.388149:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:11304:x1877361169582464:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 755us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391438.388157:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 95 00000100:00100000:3.0:1790391438.455078:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391438.455172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169582720 00000100:00100000:2.0:1790391438.455181:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169582720 00000100:00100000:2.0:1790391438.455246:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 96 00000100:00100000:2.0:1790391438.455256:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:11307:x1877361169582720:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391438.455279:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391438.455314:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1610 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0203 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455388:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1617 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455403:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1617 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455415:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1617 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455430:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e161e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455437:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e161e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455443:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e161e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455563:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455571:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455592:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391438.455603:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1790391438.455683:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1617 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455690:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1617 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455696:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455702:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391438.455705:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1617 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455713:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1617 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455725:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391438.455728:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391438.455732:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1617 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455738:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1617 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455749:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e161e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455755:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e161e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455766:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e161e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455771:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391438.455773:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e161e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455779:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e161e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455786:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e52b9b6c000) 00010000:00010000:2.0:1790391438.455788:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391438.455791:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e161e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455797:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e161e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455837:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1610 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0203 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455850:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0203 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.455857:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:2.0:1790391438.455859:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391438.455861:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d800, rc 0) 00000100:00100000:2.0:1790391438.455995:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:11307:x1877361169582720:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 705us (891us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1790391438.456011:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 96 00000100:00100000:0.0:1790391438.466391:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391438.466469:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169582848 00000100:00100000:1.0:1790391438.466488:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169582848 00000100:00100000:1.0:1790391438.466555:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 97 00000100:00100000:1.0:1790391438.466566:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:11307:x1877361169582848:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:1.0:1790391438.466629:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1633 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.466645:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.466657:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.466693:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.466700:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1633 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.466706:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1633 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.466713:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391438.466717:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1633 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.466725:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1633 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.466736:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:1.0:1790391438.466739:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391438.466745:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1633 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.466763:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1633 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391438.466838:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:11307:x1877361169582848:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 273us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.466846:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 97 00000100:00100000:3.0:1790391438.469045:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391438.469147:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169583104 00000100:00100000:1.0:1790391438.469158:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169583104 00000100:00100000:1.0:1790391438.469215:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391438.469225:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:11307:x1877361169583104:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391438.469455:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:11307:x1877361169583104:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 231us (417us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1790391438.469463:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:0.0:1790391438.548607:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.548736:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169583360 00000100:00100000:3.0:1790391438.548746:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169583360 00000100:00100000:3.0:1790391438.548805:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 98 00000100:00100000:3.0:1790391438.548826:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:10824:x1877361169583360:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:3.0:1790391438.548851:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391438.548871:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e163a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b020a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.549024:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.549040:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0203 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.549049:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.549083:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0203 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.549097:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0203 expref: 24 pid: 6513 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391438.549111:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288347100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186443264:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391438.549205:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183880780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391438.554813:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391438.554923:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169583488 00000100:00100000:1.0:1790391438.554931:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169583488 00010000:00010000:1.0:1790391438.554980:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0203 expref: 25 pid: 6513 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391438.555014:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:1.0:1790391438.555024:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:2383:x1877361169583488:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391438.555039:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391438.555046:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0203 expref: 25 pid: 6513 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.555059:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0203 expref: 25 pid: 6513 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.555099:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:1.0:1790391438.555105:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.555115:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.555122:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.555142:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391438.555193:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:2383:x1877361169583488:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 169us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.555200:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 65 00010000:00010000:3.0:1790391438.555617:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1625 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0203 expref: 24 pid: 6513 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391438.555634:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288347100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186443264:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391438.555656:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.555676:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.555682:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391438.555700:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790391438.555832:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e163a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b020a expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.555847:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b020a expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.555854:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:3.0:1790391438.555857:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790391438.555859:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d400, rc 0) 00000100:00100000:3.0:1790391438.555924:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:10824:x1877361169583360:12345-192.168.202.28@tcp:101:bash.0 Request processed in 7100us (7326us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1790391438.555931:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 98 00000100:00100000:2.0:1790391438.571246:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391438.571334:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169583616 00000100:00100000:1.0:1790391438.571344:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169583616 00000100:00100000:1.0:1790391438.571405:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 99 00000100:00100000:1.0:1790391438.571416:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:10824:x1877361169583616:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:1.0:1790391438.571451:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391438.571473:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e164f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0211 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.571508:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1656 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.571522:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.571534:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.571673:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e164f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0211 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.571692:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1656 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0211 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.571700:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:1.0:1790391438.571703:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790391438.571707:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086000, rc 0) 00000100:00100000:1.0:1790391438.571774:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:10824:x1877361169583616:12345-192.168.202.28@tcp:101:bash.0 Request processed in 359us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.571782:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 99 00000100:00100000:1.0:1790391438.574767:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.575089:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169583872 00000100:00100000:3.0:1790391438.575100:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169583872 00000100:00100000:3.0:1790391438.575168:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 100 00000100:00100000:3.0:1790391438.575179:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:10824:x1877361169583872:12345-192.168.202.28@tcp:36:bash.0 00010000:00010000:3.0:1790391438.575417:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.575434:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.575458:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391438.575503:0:10091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1790391438.575526:0:10091:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d750892 reply state 00000000abeeefe8 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.575550:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.575558:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:3.0:1790391438.575561:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391438.575565:0:10091:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790391438.575637:0:10091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1790391438.575729:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:10824:x1877361169583872:12345-192.168.202.28@tcp:36:bash.0 Request processed in 551us (970us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1790391438.575736:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 100 00000020:00080000:3.0:1790391438.575741:0:10091:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790391438.579103:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391438.579419:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169584000 00000100:00100000:1.0:1790391438.579431:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169584000 00000100:00100000:1.0:1790391438.579637:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 101 00000100:00100000:1.0:1790391438.579649:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:10824:x1877361169584000:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:1.0:1790391438.579671:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391438.579690:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1664 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0218 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.579746:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0218 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.579760:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0218 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.579799:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:1.0:1790391438.579802:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391438.579806:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086400, rc 0) 00000100:00100000:1.0:1790391438.579903:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:10824:x1877361169584000:12345-192.168.202.28@tcp:101:bash.0 Request processed in 229us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.579910:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 101 00000100:00100000:2.0:1790391438.582794:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391438.583034:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169584128 00000100:00100000:0.0:1790391438.583045:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169584128 00000100:00100000:0.0:1790391438.583143:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 41 00000100:00100000:0.0:1790391438.583155:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:10824:x1877361169584128:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:0.0:1790391438.583173:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391438.583193:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e166b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b021f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391438.583218:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6ab7348b, atime: 0x6ab73489, ctime: 0x6ab7348b, blocks: 0x8 00010000:00010000:0.0:1790391438.583241:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1790391438.583246:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391438.583255:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e166b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b021f expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.583275:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e166b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b021f expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.583289:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef400, rc 0) 00000100:00100000:0.0:1790391438.583382:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:10824:x1877361169584128:12345-192.168.202.28@tcp:101:bash.0 Request processed in 229us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391438.583390:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 41 00000100:00100000:1.0:1790391438.585393:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.585557:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169584256 00000100:00100000:3.0:1790391438.585566:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169584256 00002000:00010000:3.0:1790391438.585606:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1790391438.585611:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e52bfb0dc00 with x1877361169584256 ext(0->18446744073709551615) 00002000:00010000:3.0:1790391438.585622:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e52bfb0dc00. 00000100:00100000:3.0:1790391438.585645:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:3.0:1790391438.585654:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169584256:12345-192.168.202.28@tcp:10:bash.0 00002000:00010000:3.0:1790391438.585973:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1790391438.585977:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1790391435 -> 1790391439 00002000:00010000:3.0:1790391438.585979:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1790391433 -> 1790391433 00002000:00010000:3.0:1790391438.585990:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1790391435 -> 1790391439 00002000:00010000:3.0:1790391438.585992:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1790391438.586050:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169584256:12345-192.168.202.28@tcp:10:bash.0 Request processed in 397us (663us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790391438.586058:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 1 00002000:00010000:3.0:1790391438.586062:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1790391438.586064:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e52bfb0dc00 with x1877361169584256 ext(0->18446744073709551615) 00002000:00010000:3.0:1790391438.586069:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e52bfb0dc00. 00000100:00080000:2.0:1790391438.588785:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391438.662156:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.662245:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169584384 00000100:00100000:3.0:1790391438.662254:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169584384 00000100:00100000:3.0:1790391438.662308:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 102 00000100:00100000:3.0:1790391438.662317:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:11321:x1877361169584384:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:3.0:1790391438.662384:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1672 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662399:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1672 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662413:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1672 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662428:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1679 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662445:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662452:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662550:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662560:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662567:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391438.662610:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662622:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1672 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662628:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1672 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662635:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1672 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662641:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391438.662645:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1672 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662653:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1672 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662664:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391438.662667:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391438.662672:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1672 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662687:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1672 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662700:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662706:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1679 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662711:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1679 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662715:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391438.662718:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1679 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662723:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1679 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662731:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e51821bbb00) 00010000:00010000:3.0:1790391438.662734:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391438.662736:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1679 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662742:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1679 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662769:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662775:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662785:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662791:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391438.662793:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662800:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662807:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:3.0:1790391438.662809:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391438.662812:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.662818:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1680 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391438.662940:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:11321:x1877361169584384:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 622us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.662947:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 102 00000100:00100000:1.0:1790391438.690633:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.690744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169584640 00000100:00100000:3.0:1790391438.690753:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169584640 00000100:00100000:3.0:1790391438.690802:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 103 00000100:00100000:3.0:1790391438.690809:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:11324:x1877361169584640:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:3.0:1790391438.690829:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391438.690850:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1687 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0226 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.690971:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e168e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.690989:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e168e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691001:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e168e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691017:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1695 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691024:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1695 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691031:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1695 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691144:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e169c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691154:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e169c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691160:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e169c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391438.691169:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790391438.691244:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e168e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691251:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e168e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691264:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e168e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691270:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391438.691274:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e168e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691281:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e168e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691343:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391438.691348:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391438.691353:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e168e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691359:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e168e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691375:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1695 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691380:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1695 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691386:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1695 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691391:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391438.691394:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1695 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691412:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1695 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691420:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e51821bbb00) 00010000:00010000:3.0:1790391438.691422:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391438.691426:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1695 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691500:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1695 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691597:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1687 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0226 expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691609:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e169c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0226 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.691616:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:3.0:1790391438.691618:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790391438.691620:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d000, rc 0) 00000100:00100000:3.0:1790391438.691683:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:11324:x1877361169584640:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 873us (1059us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1790391438.691690:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 103 00000100:00100000:1.0:1790391438.694181:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.694269:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169584768 00000100:00100000:3.0:1790391438.694280:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169584768 00000100:00100000:3.0:1790391438.694456:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 104 00000100:00100000:3.0:1790391438.694467:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:11324:x1877361169584768:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:3.0:1790391438.694553:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.694569:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b020a expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.694579:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.694611:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b020a expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.694624:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b020a expref: 32 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391438.694637:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288347100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186443392:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391438.694723:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183880b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391438.696869:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.697012:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288347100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186443392:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391438.697036:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391438.697107:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169585024 00000100:00100000:1.0:1790391438.697114:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169585024 00000100:00100000:1.0:1790391438.697166:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:1.0:1790391438.697175:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:6155:x1877361169585024:12345-192.168.202.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790391438.697449:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:6155:x1877361169585024:12345-192.168.202.28@tcp:35:ldlm_bl.0 Request processed in 274us (587us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1790391438.697457:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:1.0:1790391438.699066:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391438.699145:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169585152 00000100:00100000:0.0:1790391438.699154:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169585152 00010000:00010000:0.0:1790391438.699187:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b020a expref: 34 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391438.699224:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:0.0:1790391438.699233:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:2383:x1877361169585152:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391438.699246:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391438.699253:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b020a expref: 34 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.699267:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b020a expref: 34 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.699284:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1641 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b020a expref: 34 pid: 6513 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.699305:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:0.0:1790391438.699309:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.699317:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.699322:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391438.699354:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391438.699387:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:2383:x1877361169585152:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 156us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391438.699393:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 66 00010000:00010000:3.0:1790391438.699528:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.699537:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.699579:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.699596:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.699603:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.699609:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391438.699613:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.699621:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.699630:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:3.0:1790391438.699633:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391438.699637:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.699643:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391438.699690:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:11324:x1877361169584768:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 5225us (5518us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.699696:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 104 00000100:00100000:1.0:1790391438.703207:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.703332:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169585408 00000100:00100000:3.0:1790391438.703341:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169585408 00000100:00100000:3.0:1790391438.703420:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:3.0:1790391438.703440:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:11324:x1877361169585408:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:3.0:1790391438.703681:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:11324:x1877361169585408:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 251us (479us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790391438.703701:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:0.0:1790391438.772053:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.772146:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169585664 00000100:00100000:3.0:1790391438.772158:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169585664 00000100:00100000:3.0:1790391438.772222:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 105 00000100:00100000:3.0:1790391438.772233:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:11335:x1877361169585664:12345-192.168.202.28@tcp:101:cat.0 00010000:00010000:3.0:1790391438.772257:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391438.772279:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b022d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772366:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e16b8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772381:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e16b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772392:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e16b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772408:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e16bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772414:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e16bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772420:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e16bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772548:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e16c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772579:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e16c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772586:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e16c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391438.772596:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1790391438.772672:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e16b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772680:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e16b8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772686:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e16b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772691:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391438.772695:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e16b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772702:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e16b8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772714:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391438.772717:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391438.772722:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e16b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772727:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e16b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772739:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e16bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772750:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e16bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772756:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e16bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772760:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391438.772763:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e16bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772769:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e16bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772776:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e51821bbb00) 00010000:00010000:3.0:1790391438.772779:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391438.772782:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e16bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772787:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e16bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772843:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d800/0x2b1b7949f13e16b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b022d expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772856:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e16c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b022d expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.772863:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:3.0:1790391438.772866:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391438.772931:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763de00, rc 0) 00000100:00100000:3.0:1790391438.773003:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:11335:x1877361169585664:12345-192.168.202.28@tcp:101:cat.0 Request processed in 771us (959us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1790391438.773010:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 105 00000100:00100000:0.0:1790391438.781434:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391438.781551:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169585920 00000100:00100000:2.0:1790391438.781561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169585920 00000100:00100000:2.0:1790391438.781615:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:2.0:1790391438.781626:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:11335:x1877361169585920:12345-192.168.202.28@tcp:35:cat.0 00000100:00100000:2.0:1790391438.781932:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:11335:x1877361169585920:12345-192.168.202.28@tcp:35:cat.0 Request processed in 306us (507us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1790391438.781940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:0.0:1790391438.810790:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391438.811151:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169586176 00000100:00100000:2.0:1790391438.811160:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169586176 00000100:00100000:2.0:1790391438.811217:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 106 00000100:00100000:2.0:1790391438.811227:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:11336:x1877361169586176:12345-192.168.202.28@tcp:36:rm.0 00010000:00010000:2.0:1790391438.811282:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1790391438.811320:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1664 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0218 expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811342:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e16c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b022d expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811354:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e169c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0226 expref: 34 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811388:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1656 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0211 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811398:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:2.0:1790391438.811403:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391438.811425:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e16d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811453:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e16d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811463:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e16d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811478:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811485:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811492:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811777:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e16e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811787:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e16e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.811794:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e16e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391438.812109:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1790391438.812120:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352179241982ns, next at 353179239342ns, rc = 0 00010000:00010000:2.0:1790391438.812163:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812171:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812178:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812185:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812191:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812197:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812221:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391438.812238:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e16e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812244:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e16e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812249:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e16e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812254:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391438.812265:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e16e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812273:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e16e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812281:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:2.0:1790391438.812284:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790391438.812288:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e16e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812293:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e16e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812308:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e16d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812314:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e16d4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812320:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e16d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812325:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391438.812328:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e16d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812333:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e16d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812340:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391438.812343:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391438.812351:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e16d4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812358:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e16d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391438.812368:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd7bc94e reply state 000000009fb93139 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812379:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.812386:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e52b9b6c000) 00010000:00010000:2.0:1790391438.812388:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790391438.812391:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391438.812923:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:11336:x1877361169586176:12345-192.168.202.28@tcp:36:rm.0 Request processed in 1694us (2138us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1790391438.812933:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 106 00010000:00010000:1.0:1790391438.813010:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391438.813018:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.813024:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391438.813027:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.813041:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.813051:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:1.0:1790391438.813054:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790391438.813057:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.813063:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e16e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.813073:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391438.813075:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391438.813076:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391438.856380:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186443776:0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.856504:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391438.856675:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186443648:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.856708:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391438.856753:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186444160:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.856775:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391438.856801:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186444672:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.856821:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391438.856845:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1790391438.856852:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186443520:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.856901:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391438.856926:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186444032:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.856948:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391438.856978:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186444544:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.856999:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391438.857018:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186445056:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.857037:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391438.857070:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186443520 00000100:00100000:3.0:1790391438.857076:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186443520 00000100:00100000:3.0:1790391438.857123:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1790391438.857133:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186443520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.857185:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e8e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186443520:12345-0@lo:400:kworker.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.857209:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1790391438.857257:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186443776 00000100:00100000:3.0:1790391438.857261:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186443776 00000100:00100000:3.0:1790391438.857284:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186444032 00000100:00100000:3.0:1790391438.857287:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186444032 00000100:00100000:3.0:1790391438.857316:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790391438.857322:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186443776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.857358:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186443776:12345-0@lo:400:kworker.0 Request processed in 37us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.857364:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790391438.857376:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790391438.857381:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186444032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.857407:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186444032:12345-0@lo:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.857413:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790391438.857430:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186444544 00000100:00100000:3.0:1790391438.857434:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186444544 00000100:00100000:3.0:1790391438.857721:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186445056 00000100:00100000:3.0:1790391438.857725:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186445056 00000100:00100000:3.0:1790391438.857750:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790391438.857756:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186444544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.857795:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186444544:12345-0@lo:400:kworker.0 Request processed in 39us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.857801:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790391438.857812:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790391438.857818:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186445056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.857860:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186445056:12345-0@lo:400:kworker.0 Request processed in 41us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.857866:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790391438.857934:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186443520:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.857948:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186444032:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.857969:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186444544:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.857981:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186445056:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.858021:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186443648 00000100:00100000:3.0:1790391438.858024:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186443648 00000100:00100000:3.0:1790391438.858048:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186444160 00000100:00100000:3.0:1790391438.858051:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186444160 00000100:00100000:3.0:1790391438.858062:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186444672 00000100:00100000:3.0:1790391438.858065:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186444672 00000100:00100000:3.0:1790391438.858076:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1790391438.858082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186443648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.858118:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186443648:12345-0@lo:400:kworker.0 Request processed in 36us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.858124:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1790391438.858135:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1790391438.858142:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186444160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.858168:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186444160:12345-0@lo:400:kworker.0 Request processed in 28us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.858173:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1790391438.858183:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790391438.858188:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186444672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858490:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186443776:0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858499:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186444288:0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858526:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391438.858608:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186444800:0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858630:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391438.858651:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790391438.858657:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186443904:0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858678:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391438.858688:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186444416:0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858704:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391438.858729:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186444928:0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858747:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391438.858777:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186444416 00000100:00100000:1.0:1790391438.858780:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186444416 00000100:00100000:1.0:1790391438.858804:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186444928 00000100:00100000:1.0:1790391438.858807:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186444928 00000100:00100000:1.0:1790391438.858818:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790391438.858824:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186444416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858853:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186444416:12345-0@lo:400:kworker.0 Request processed in 29us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.858859:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790391438.858869:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790391438.858889:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186444928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858913:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186444928:12345-0@lo:400:kworker.0 Request processed in 39us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.858918:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790391438.858943:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186444416:0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858951:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186444928:0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.858999:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186444288 00000100:00100000:1.0:1790391438.859002:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186444288 00000100:00100000:1.0:1790391438.859017:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186444800 00000100:00100000:1.0:1790391438.859019:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186444800 00000100:00100000:1.0:1790391438.859028:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186443904 00000100:00100000:1.0:1790391438.859030:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186443904 00000100:00100000:1.0:1790391438.859040:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1790391438.859045:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186444288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.859074:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186444288:12345-0@lo:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.859085:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1790391438.859096:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790391438.859101:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186444800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.859123:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186444800:12345-0@lo:400:kworker.0 Request processed in 22us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.859128:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790391438.859136:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790391438.859141:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186443904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391438.859160:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186443904:12345-0@lo:400:kworker.0 Request processed in 19us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.859165:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790391438.859183:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186443904:0@lo:400:kworker.0 00010000:00080000:1.0:1790391438.859195:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52b76adf80 x1877361186444288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391438.859206:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186444288:0@lo:400:kworker.0 00010000:00080000:1.0:1790391438.859214:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183a40380 x1877361186444800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391438.859222:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186444800:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.859901:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186444672:12345-0@lo:400:kworker.0 Request processed in 46us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.859911:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1790391438.859952:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186443648:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.859975:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186444160:0@lo:400:kworker.0 00000100:00100000:3.0:1790391438.859986:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186444672:0@lo:400:kworker.0 00000100:00080000:3.0:1790391438.860974:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391438.860980:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391438.860984:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391438.860987:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391438.878743:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391438.878861:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169586432 00000100:00100000:1.0:1790391438.878871:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169586432 00000100:00100000:1.0:1790391438.879001:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 107 00000100:00100000:1.0:1790391438.879012:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:11342:x1877361169586432:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:1.0:1790391438.879040:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391438.879078:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e16f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0234 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.879198:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e16f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.879227:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e16f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.879247:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e16f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.879259:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.879267:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.879272:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790391438.879793:0:10091:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1790391438.879975:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.879985:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.879993:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880024:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e16f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880045:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e16f7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880052:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e16f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880058:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391438.880062:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e16f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880069:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e16f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880080:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:1.0:1790391438.880083:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391438.880087:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e16f7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880094:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e16f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391438.880107:0:10091:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058dee74d reply state 00000000c3e7070b transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880118:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880124:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e52b9b6c000) 00010000:00010000:1.0:1790391438.880126:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391438.880129:0:10091:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790391438.880159:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e16f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0234 expref: 37 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880181:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0234 expref: 36 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.880188:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48700) 00010000:00010000:1.0:1790391438.880191:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391438.880193:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086c00, rc 0) 00000100:00100000:1.0:1790391438.880604:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:11342:x1877361169586432:12345-192.168.202.28@tcp:101:bash.0 Request processed in 1593us (1868us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1790391438.880612:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 107 00000100:00100000:0.0:1790391438.883603:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391438.883860:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169586560 00000100:00100000:3.0:1790391438.883870:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169586560 00000100:00100000:3.0:1790391438.883971:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 42 00000100:00100000:3.0:1790391438.883982:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169586560:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:3.0:1790391438.884004:0:10505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391438.884029:0:10505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e1713 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b023b expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790391438.884054:0:10505:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391438.884073:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1790391438.884078:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391438.884087:0:10505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e1713 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b023b expref: 8 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.884106:0:10505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e1713 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b023b expref: 8 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391438.884134:0:10505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d800, rc 0) 00000100:00100000:3.0:1790391438.884187:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169586560:12345-192.168.202.28@tcp:101:bash.0 Request processed in 206us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391438.884194:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 42 00000100:00080000:2.0:1790391438.884323:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391438.887855:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391438.888008:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169586688 00000100:00100000:1.0:1790391438.888019:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169586688 00000100:00100000:1.0:1790391438.888066:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 43 00000100:00100000:1.0:1790391438.888076:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:11342:x1877361169586688:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:1.0:1790391438.888095:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391438.888114:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0242 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.888147:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e1713 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b023b expref: 9 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.888156:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391438.888160:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391438.888166:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.888219:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e1713 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b023b expref: 9 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.888232:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e1713 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b023b expref: 9 pid: 10505 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391438.888315:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1877361186445184:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391438.888401:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0b41600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391438.891525:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391438.891645:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1877361186445184:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391438.891678:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391438.891697:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087200, rc 0) 00000100:00100000:1.0:1790391438.891755:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:11342:x1877361169586688:12345-192.168.202.28@tcp:101:bash.0 Request processed in 3680us (3910us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391438.891764:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 43 00000100:00100000:2.0:1790391438.892499:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169586816 00000100:00100000:2.0:1790391438.892508:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169586816 00010000:00010000:2.0:1790391438.892554:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e1713 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b023b expref: 9 pid: 10505 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391438.892592:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:2.0:1790391438.892603:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2384:x1877361169586816:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391438.892616:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391438.892648:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e1713 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b023b expref: 9 pid: 10505 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.892681:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e1713 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b023b expref: 9 pid: 10505 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.892703:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e1713 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b023b expref: 9 pid: 10505 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.892718:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391438.892722:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391438.892731:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.892742:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391438.892780:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391438.892795:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1877361186445312:192.168.202.28@tcp:105: 00000100:00100000:2.0:1790391438.892860:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295584780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391438.897178:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6497:1877361186445312:192.168.202.28@tcp:105: 00010000:00010000:2.0:1790391438.897205:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391438.897265:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169586816:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 4662us (5748us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391438.897275:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:3.0:1790391438.899177:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391438.899289:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169587072 00000100:00100000:2.0:1790391438.899308:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169587072 00000100:00100000:2.0:1790391438.899362:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:2.0:1790391438.899372:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:11342:x1877361169587072:12345-192.168.202.28@tcp:35:bash.0 00000100:00100000:2.0:1790391438.900049:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:11342:x1877361169587072:12345-192.168.202.28@tcp:35:bash.0 Request processed in 674us (875us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1790391438.900058:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:1.0:1790391439.139668:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391439.142681:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169587200 00000100:00100000:3.0:1790391439.142705:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169587200 00000100:00100000:3.0:1790391439.142920:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 108 00000100:00100000:3.0:1790391439.142934:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:11358:x1877361169587200:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:3.0:1790391439.142979:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391439.143078:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0249 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.143182:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1728 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.143199:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1728 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.143214:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1728 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391439.143274:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790391439.143279:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391439.143303:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1728 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.143333:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0249 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.143380:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1728 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0249 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.143390:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391439.143394:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391439.143397:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c600, rc 0) 00000100:00100000:3.0:1790391439.143630:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:11358:x1877361169587200:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 697us (3978us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391439.143639:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 108 00000100:00100000:0.0:1790391439.155449:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391439.157686:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169587456 00000100:00100000:3.0:1790391439.157707:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169587456 00000100:00100000:3.0:1790391439.157901:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 109 00000100:00100000:3.0:1790391439.157914:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:11358:x1877361169587456:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:3.0:1790391439.157947:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391439.157989:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e172f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0250 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.158157:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1736 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.158174:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.158188:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391439.158202:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790391439.158375:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e172f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0250 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.158398:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1736 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0250 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.158408:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48700) 00010000:00010000:3.0:1790391439.158411:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391439.158416:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c200, rc 0) 00000100:00100000:3.0:1790391439.158511:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+41:11358:x1877361169587456:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 599us (3078us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1790391439.158519:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 109 00000100:00100000:0.0:1790391439.165486:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391439.165680:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169587840 00000100:00100000:1.0:1790391439.165695:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169587840 00000100:00100000:1.0:1790391439.165819:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:1.0:1790391439.165833:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+41:2381:x1877361169587840:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391439.165868:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391439.165938:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1736 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0250 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.165989:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48700) 00010000:00010000:1.0:1790391439.165996:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391439.166086:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:2381:x1877361169587840:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 256us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391439.166094:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:0.0:1790391439.176728:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391439.176868:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169587712 00000100:00100000:2.0:1790391439.176911:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169587712 00000100:00100000:2.0:1790391439.177004:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 110 00000100:00100000:2.0:1790391439.177075:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:11358:x1877361169587712:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391439.177104:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391439.177133:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1744 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0257 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.177665:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e174b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.177681:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e174b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.177693:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e174b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391439.177706:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790391439.177831:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1744 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0257 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.177850:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e174b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0257 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.177928:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48700) 00010000:00010000:2.0:1790391439.177933:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790391439.177938:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ce00, rc 0) 00000100:00100000:2.0:1790391439.178195:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+42:11358:x1877361169587712:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 1122us (1481us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1790391439.178203:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 110 00000100:00100000:2.0:1790391439.190603:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391439.190738:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169587968 00000100:00100000:0.0:1790391439.190752:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169587968 00000100:00100000:0.0:1790391439.191488:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:0.0:1790391439.191504:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169587968:12345-192.168.202.28@tcp:1:lfs.0 00010000:00010000:0.0:1790391439.191583:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.191609:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.191619:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391439.191624:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391439.191648:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.191700:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.191718:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 8 pid: 8429 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391439.191735:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1877361186445440:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391439.191924:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822dfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391439.198981:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391439.199218:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169588096 00000100:00100000:1.0:1790391439.199238:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169588096 00002000:00100000:1.0:1790391439.199435:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9e51838a0e00 x1877361169588096/t0(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:305/0 lens 504/0 e 0 to 0 dl 1790391450 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790391439.199447:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e51838a0e00 with x1877361169588096 ext(0->8) 00010000:00010000:1.0:1790391439.199460:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 9 pid: 8429 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.199481:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 9 pid: 8429 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391439.199490:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e51838a0e00 00000100:00100000:1.0:1790391439.199593:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:1.0:1790391439.199609:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2383:x1877361169588096:12345-192.168.202.28@tcp:4:lfs.0 00000100:00100000:2.0:1790391439.202166:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1877361186445440:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391439.202213:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391439.203381:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:2383:x1877361169588096:12345-192.168.202.28@tcp:4:lfs.0 Request processed in 3762us (4403us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1790391439.203397:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 1 00002000:00100000:1.0:1790391439.203412:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9e51838a0e00 x1877361169588096/t4294967303(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:305/0 lens 504/448 e 0 to 0 dl 1790391450 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790391439.203442:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e51838a0e00 with x1877361169588096 ext(0->8) 00010000:00010000:1.0:1790391439.203454:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 11 pid: 8429 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.203473:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 11 pid: 8429 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391439.203481:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e51838a0e00 00000001:00080000:0.0:1790391439.209399:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1790391439.209416:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1790391439.219097:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391439.220249:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169588224 00000100:00100000:0.0:1790391439.220267:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169588224 00010000:00010000:0.0:1790391439.220322:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 7 pid: 8429 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391439.220381:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:0.0:1790391439.220392:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2382:x1877361169588224:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391439.220407:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790391439.220425:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790391439.220428:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790391439 00002000:00010000:0.0:1790391439.220431:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790391439 00002000:00010000:0.0:1790391439.220433:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1790391439 00002000:00010000:0.0:1790391439.220435:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1790391439.220456:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 7 pid: 8429 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.220471:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 7 pid: 8429 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.220493:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb566a02/0x2b1b7949f13e171a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0242 expref: 7 pid: 8429 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.220509:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391439.220514:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391439.220519:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.220529:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.220570:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391439.220638:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169588224:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 248us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391439.220646:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 68 00010000:00010000:3.0:1790391439.221175:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.221186:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.221207:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.221216:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.221225:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.221243:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391439.221248:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.221260:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.221273:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.221281:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e1759 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391439.221362:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169587968:12345-192.168.202.28@tcp:1:lfs.0 Request processed in 29862us (30835us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391439.221371:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:1.0:1790391439.223426:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391439.223503:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169588480 00000100:00100000:3.0:1790391439.223513:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169588480 00000100:00100000:3.0:1790391439.223578:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:3.0:1790391439.223588:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+42:11358:x1877361169588480:12345-192.168.202.28@tcp:35:lfs.0 00000004:00010000:3.0:1790391439.223651:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e174b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0257 expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391439.224325:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1790391439.224373:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1790391439.224730:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1790391439.224773:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.224791:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0234 expref: 46 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.224800:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.224838:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0234 expref: 46 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.224853:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0234 expref: 46 pid: 10091 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391439.224868:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1877361186445568:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391439.225067:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183880840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391439.230153:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1877361186445568:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391439.230185:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391439.231465:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391439.231721:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169588608 00000100:00100000:0.0:1790391439.231731:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169588608 00010000:00010000:0.0:1790391439.231768:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0234 expref: 47 pid: 10091 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391439.231807:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 69 00000100:00100000:0.0:1790391439.231818:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+47:2384:x1877361169588608:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391439.231846:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391439.231853:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0234 expref: 47 pid: 10091 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.231868:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0234 expref: 47 pid: 10091 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.232004:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1705 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0234 expref: 47 pid: 10091 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.232023:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48700) 00010000:00010000:0.0:1790391439.232028:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.232038:0:10388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.232046:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.232117:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391439.232179:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+46:2384:x1877361169588608:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 362us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391439.232188:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 69 00010000:00010000:3.0:1790391439.237032:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.237050:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391439.237178:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1790391439.237301:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1790391439.237421:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877361186445696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790391439.237488:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391439.238221:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51838809c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391439.238458:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186445696 00000100:00100000:1.0:1790391439.238468:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186445696 00000100:00100000:1.0:1790391439.238628:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790391439.238639:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1877361186445696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790391439.238754:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1877361186445696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391439.238762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790391439.238826:0:6515:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1790391439.238832:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1790391439.238851:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e52bfa6b800, transno 4294967302 00000100:00100000:0.0:1790391439.238900:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877361186445696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790391439.239062:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1790391439.239137:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877361186445824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790391439.239176:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391439.239687:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df900 going to sleep for 11 seconds 00000100:00100000:3.0:1790391439.239759:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186445824 00000100:00100000:3.0:1790391439.239765:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186445824 00000100:00100000:3.0:1790391439.239794:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790391439.239800:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1877361186445824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790391439.239963:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6515:x1877361186445824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 152us (776us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790391439.239971:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790391439.240110:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877361186445824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790391439.240156:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1790391439.240189:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.240199:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.240206:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.240211:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391439.240216:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.240224:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.240239:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48700) 00010000:00010000:0.0:1790391439.240242:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790391439.240247:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.240253:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1760 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790391439.240347:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790391439.240412:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1790391439.240423:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352607545034ns, next at 353607542604ns, rc = 0 00000001:00080000:0.0:1790391439.240430:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1790391439.240452:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48700) 00010000:00010000:0.0:1790391439.240454:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790391439.240461:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e174b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0257 expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391439.240780:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+49:11358:x1877361169588480:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 17191us (17360us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1790391439.240789:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 26 00000020:00080000:0.0:1790391439.240793:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790391439.245517:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391439.246065:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169588736 00000100:00100000:1.0:1790391439.246076:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169588736 00000100:00100000:1.0:1790391439.246151:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 111 00000100:00100000:1.0:1790391439.246162:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+49:11358:x1877361169588736:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391439.246197:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391439.246234:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e1767 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b025e expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.246322:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e1767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b025e expref: 50 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.246338:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e1767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b025e expref: 50 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.246369:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391439.246373:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391439.246377:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086200, rc 0) 00000100:00100000:1.0:1790391439.246451:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+50:11358:x1877361169588736:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 291us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391439.246459:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 111 00000100:00100000:3.0:1790391439.254440:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391439.254676:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169588992 00000100:00100000:2.0:1790391439.254686:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169588992 00000100:00100000:2.0:1790391439.254778:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:2.0:1790391439.254790:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+50:11358:x1877361169588992:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:2.0:1790391439.255207:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+51:11358:x1877361169588992:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 417us (776us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1790391439.255215:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 27 00010000:00010000:0.0:1790391439.305291:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391439.347984:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391439.348242:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169589120 00000100:00100000:3.0:1790391439.348254:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169589120 00000100:00100000:3.0:1790391439.348318:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 112 00000100:00100000:3.0:1790391439.348328:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+51:11368:x1877361169589120:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:3.0:1790391439.348402:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e176e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348419:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e176e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348442:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e176e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348492:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1775 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348501:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348522:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348618:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348627:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348635:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391439.348683:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348697:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e176e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348703:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e176e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348710:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e176e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348716:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391439.348721:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e176e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348728:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e176e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348740:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391439.348749:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391439.348754:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e176e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348761:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e176e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348774:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348780:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1775 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348786:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348792:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763da00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391439.348795:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348801:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348820:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e52b9b6c000) 00010000:00010000:3.0:1790391439.348823:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391439.348826:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1775 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348832:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1775 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348842:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348854:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348860:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.348865:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391439.348868:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.349175:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.349187:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:3.0:1790391439.349189:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391439.349193:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.349200:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e177c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391439.349286:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+51:11368:x1877361169589120:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 957us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391439.349295:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 112 00000100:00100000:2.0:1790391439.370283:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391439.370318:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186445952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391439.370456:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391439.370539:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186445952 00000100:00100000:2.0:1790391439.370547:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186445952 00000100:00100000:2.0:1790391439.370595:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790391439.370619:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186445952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790391439.370644:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1790391439.370686:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186445952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391439.370693:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790391439.370748:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186445952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391439.371358:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391439.371373:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51833c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186446080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391439.371413:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391439.373381:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186446080 00000100:00100000:1.0:1790391439.373397:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186446080 00000100:00100000:1.0:1790391439.373473:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790391439.373486:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186446080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391439.373514:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:1.0:1790391439.373597:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186446080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391439.373604:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790391439.373658:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51833c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186446080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391439.419321:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391439.419523:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169589376 00000100:00100000:1.0:1790391439.419547:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169589376 00000100:00100000:1.0:1790391439.419639:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 113 00000100:00100000:1.0:1790391439.419679:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+51:11371:x1877361169589376:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391439.419709:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391439.419737:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1783 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0265 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.419854:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e178a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.419873:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e178a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.419930:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e178a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.419945:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1791 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.419965:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1791 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.419973:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1791 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420123:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1798 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420132:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1798 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420141:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1798 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391439.420165:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790391439.420284:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e178a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420293:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e178a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420300:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e178a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420307:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391439.420313:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e178a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420323:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e178a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420338:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:1.0:1790391439.420341:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391439.420346:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e178a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420352:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e178a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420368:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1791 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420373:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1791 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420390:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1791 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420396:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391439.420399:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1791 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420405:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1791 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420414:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e52b9b6c000) 00010000:00010000:1.0:1790391439.420417:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391439.420420:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1791 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420427:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1791 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420470:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1783 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0265 expref: 54 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420485:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1798 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0265 expref: 53 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.420493:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391439.420495:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391439.420497:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087800, rc 0) 00000100:00100000:1.0:1790391439.420589:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+53:11371:x1877361169589376:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 912us (1286us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1790391439.420606:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 113 00000100:00100000:1.0:1790391439.435240:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391439.435347:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169589504 00000100:00100000:2.0:1790391439.435362:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169589504 00000100:00100000:2.0:1790391439.435448:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 114 00000100:00100000:2.0:1790391439.435461:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+53:11371:x1877361169589504:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:2.0:1790391439.435531:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.435547:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.435559:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.435598:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.435605:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.435611:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.435617:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391439.435634:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.435643:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.435655:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:2.0:1790391439.435658:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391439.435663:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.435668:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391439.435765:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+53:11371:x1877361169589504:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 299us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391439.435773:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 114 00000100:00100000:2.0:1790391439.450599:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391439.450698:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169589760 00000100:00100000:0.0:1790391439.450708:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169589760 00000100:00100000:0.0:1790391439.450773:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:0.0:1790391439.450783:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+53:11371:x1877361169589760:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:0.0:1790391439.451376:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+54:11371:x1877361169589760:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 591us (784us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1790391439.451386:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:0.0:1790391439.576123:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391439.584437:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169590016 00000100:00100000:1.0:1790391439.584462:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169590016 00000100:00100000:1.0:1790391439.584565:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 115 00000100:00100000:1.0:1790391439.584583:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+54:11381:x1877361169590016:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:1.0:1790391439.584626:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391439.584630:0:10091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790391439.584666:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1728 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0249 expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.584694:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:1.0:1790391439.584701:0:10091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391439.584720:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e17ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b026c expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.584861:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e17b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.584935:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e17b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.584957:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e17b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391439.584969:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790391439.585107:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e17ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b026c expref: 56 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.585154:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e17b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b026c expref: 55 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.585163:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391439.585166:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391439.585170:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086000, rc 0) 00000100:00100000:1.0:1790391439.585278:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+55:11381:x1877361169590016:12345-192.168.202.28@tcp:101:bash.0 Request processed in 701us (9165us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1790391439.585287:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 115 00000100:00100000:1.0:1790391439.593491:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391439.593549:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391439.593718:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169590272 00000100:00100000:0.0:1790391439.593733:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169590272 00000100:00100000:2.0:1790391439.593968:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169590144 00000100:00100000:2.0:1790391439.593973:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169590144 00000100:00100000:2.0:1790391439.594012:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 116 00000100:00100000:2.0:1790391439.594021:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+56:11381:x1877361169590144:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391439.594053:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391439.594072:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e17c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0273 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.594104:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.594117:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.594141:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.594244:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e17c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0273 expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.594269:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0273 expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.594277:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:2.0:1790391439.594280:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391439.594283:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c600, rc 0) 00000100:00100000:2.0:1790391439.594351:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+57:11381:x1877361169590144:12345-192.168.202.28@tcp:101:bash.0 Request processed in 330us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391439.594358:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 116 00000100:00100000:0.0:1790391439.597280:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:0.0:1790391439.597303:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+56:2382:x1877361169590272:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391439.597328:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391439.597356:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e17b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b026c expref: 56 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391439.597390:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391439.597395:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391439.597465:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+55:2382:x1877361169590272:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 172us (3914us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391439.597472:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:1.0:1790391439.602238:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391439.602407:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169590528 00000100:00100000:3.0:1790391439.602441:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169590528 00000100:00100000:3.0:1790391439.602503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 117 00000100:00100000:3.0:1790391439.602514:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+55:11381:x1877361169590528:12345-192.168.202.28@tcp:36:bash.0 00010000:00010000:3.0:1790391439.602731:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391439.602758:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1798 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0265 expref: 55 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.602777:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:3.0:1790391439.602784:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391439.603505:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.603522:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.603544:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391439.603593:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1790391439.603618:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb524317 reply state 000000008a83f3a8 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.603630:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.603638:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:3.0:1790391439.603641:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391439.603644:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391439.603752:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+57:11381:x1877361169590528:12345-192.168.202.28@tcp:36:bash.0 Request processed in 1238us (1874us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1790391439.603761:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 117 00000020:00080000:3.0:1790391439.603777:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790391439.611498:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391439.611656:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169590656 00000100:00100000:3.0:1790391439.611666:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169590656 00000100:00100000:3.0:1790391439.611731:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 118 00000100:00100000:3.0:1790391439.611751:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+57:11381:x1877361169590656:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:3.0:1790391439.611775:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391439.611796:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e17d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b027a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.612401:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.612418:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.612430:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391439.612461:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790391439.612465:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391439.612486:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.612512:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e17d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b027a expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.612541:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b027a expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.612550:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:3.0:1790391439.612562:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391439.612566:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d200, rc 0) 00000100:00100000:3.0:1790391439.612646:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+58:11381:x1877361169590656:12345-192.168.202.28@tcp:101:bash.0 Request processed in 905us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391439.612655:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 118 00000100:00100000:2.0:1790391439.619375:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391439.619586:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169590912 00000100:00100000:0.0:1790391439.619596:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169590912 00000100:00100000:0.0:1790391439.619693:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:0.0:1790391439.619704:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+58:11381:x1877361169590912:12345-192.168.202.28@tcp:35:bash.0 00000100:00100000:0.0:1790391439.620312:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:11381:x1877361169590912:12345-192.168.202.28@tcp:35:bash.0 Request processed in 607us (942us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1790391439.620320:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:1.0:1790391439.746682:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391439.746781:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169591040 00000100:00100000:2.0:1790391439.746792:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169591040 00000100:00100000:2.0:1790391439.746865:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 119 00000100:00100000:2.0:1790391439.746919:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:11387:x1877361169591040:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391439.746944:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391439.746973:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e17e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0281 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.747035:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e17ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.747059:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e17ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.747073:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e17ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391439.747122:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790391439.747126:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391439.747145:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e17ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.747168:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e17e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0281 expref: 61 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.747188:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e17ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0281 expref: 60 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.747196:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391439.747199:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391439.747202:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d000, rc 0) 00000100:00100000:2.0:1790391439.747258:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:11387:x1877361169591040:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 384us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391439.747266:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 119 00000100:00100000:1.0:1790391439.751780:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391439.751862:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169591168 00000100:00100000:3.0:1790391439.751872:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169591168 00000100:00100000:3.0:1790391439.752097:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 120 00000100:00100000:3.0:1790391439.752108:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:11387:x1877361169591168:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:3.0:1790391439.752128:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391439.752149:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e17f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0288 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752211:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e17fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752224:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e17fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752234:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e17fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752245:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1801 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752253:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752260:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752362:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752371:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752379:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391439.752420:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790391439.752433:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391439.752451:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752463:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752471:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e17fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752477:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e17fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752483:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e17fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752489:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763dc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391439.752493:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e17fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752499:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e17fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752519:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391439.752522:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391439.752639:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e17fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752648:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e17fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752662:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752667:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1801 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752672:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752677:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391439.752679:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752685:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1801 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752692:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e52b9b6c000) 00010000:00010000:3.0:1790391439.752694:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391439.752697:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1801 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752703:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1801 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752741:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e17f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0288 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752754:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0288 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391439.752762:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:3.0:1790391439.752764:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391439.752766:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c600, rc 0) 00000100:00100000:3.0:1790391439.752826:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:11387:x1877361169591168:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 721us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391439.752834:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 120 00000100:00100000:0.0:1790391439.757122:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391439.757204:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169591424 00000100:00100000:2.0:1790391439.757217:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169591424 00000100:00100000:2.0:1790391439.757279:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 121 00000100:00100000:2.0:1790391439.757290:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:11387:x1877361169591424:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391439.757320:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391439.757356:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e180f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b028f expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.757481:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.757496:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b027a expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.757505:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0288 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.757514:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.757666:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0288 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.757682:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0288 expref: 62 pid: 6514 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391439.757697:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186446208:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391439.757804:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b027a expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.757813:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b027a expref: 62 pid: 6513 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391439.757822:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa31880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186446336:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391439.757856:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295584780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391439.761214:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186446208:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391439.762784:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391439.762987:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169591552 00000100:00100000:1.0:1790391439.762997:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169591552 00010000:00010000:1.0:1790391439.763038:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0288 expref: 63 pid: 6514 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391439.763080:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 70 00000100:00100000:1.0:1790391439.763090:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+63:2383:x1877361169591552:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391439.763104:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391439.763111:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0288 expref: 63 pid: 6514 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.763142:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0288 expref: 63 pid: 6514 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.763164:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c600/0x2b1b7949f13e1808 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0288 expref: 63 pid: 6514 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.763193:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391439.763198:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.763206:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.763213:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391439.763272:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+62:2383:x1877361169591552:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 183us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391439.763279:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 70 00000100:00100000:2.0:1790391439.766593:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa31880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186446336:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391439.766625:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391439.767550:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391439.768107:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169591680 00000100:00100000:1.0:1790391439.768115:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169591680 00010000:00010000:1.0:1790391439.768151:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b027a expref: 62 pid: 6513 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391439.768193:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 71 00000100:00100000:1.0:1790391439.768201:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+62:2384:x1877361169591680:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391439.768214:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391439.768220:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b027a expref: 62 pid: 6513 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.768245:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b027a expref: 62 pid: 6513 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.768266:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d200/0x2b1b7949f13e17de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b027a expref: 62 pid: 6513 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.768281:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391439.768286:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.768307:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.768315:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.768480:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391439.768542:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:2384:x1877361169591680:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 341us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391439.768549:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 71 00010000:00010000:2.0:1790391439.770778:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.770793:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391439.770817:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790391439.771041:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e180f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b028f expref: 62 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.771061:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b028f expref: 61 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.771069:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:2.0:1790391439.771072:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790391439.771076:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309de00, rc 0) 00000100:00100000:2.0:1790391439.771188:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:11387:x1877361169591424:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 13899us (14076us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1790391439.771197:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 121 00000100:00100000:3.0:1790391439.775076:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391439.775291:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169591936 00000100:00100000:1.0:1790391439.775316:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169591936 00000100:00100000:1.0:1790391439.775375:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:1.0:1790391439.775385:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:11387:x1877361169591936:12345-192.168.202.28@tcp:103:lfs.0 00010000:00010000:1.0:1790391439.775413:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391439.775448:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e1767 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b025e expref: 61 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.775488:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391439.775494:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391439.776258:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:11387:x1877361169591936:12345-192.168.202.28@tcp:103:lfs.0 Request processed in 787us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391439.776268:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:1.0:1790391439.784470:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391439.784649:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169592064 00000100:00100000:2.0:1790391439.784660:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169592064 00000100:00100000:2.0:1790391439.784717:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 122 00000100:00100000:2.0:1790391439.784744:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:11387:x1877361169592064:12345-192.168.202.28@tcp:58:lfs.0 00010000:00010000:2.0:1790391439.784859:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.784916:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391439.784930:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391439.785070:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1790391439.785155:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:11387:x1877361169592064:12345-192.168.202.28@tcp:58:lfs.0 Request processed in 414us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391439.785169:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 122 00000100:00100000:3.0:1790391439.794663:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391439.795150:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169592192 00000100:00100000:1.0:1790391439.795162:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169592192 00000100:00100000:1.0:1790391439.795244:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 123 00000100:00100000:1.0:1790391439.795254:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:11387:x1877361169592192:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391439.795277:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391439.795310:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e182b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0296 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.795367:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.795380:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e182b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0296 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.795400:0:6512:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.795414:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e182b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0296 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.795427:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391439.795442:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391439.795447:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e182b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0296 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391439.795456:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086200, rc 0) 00000100:00100000:1.0:1790391439.795535:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:11387:x1877361169592192:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 273us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391439.795543:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 123 00000100:00100000:0.0:1790391440.262653:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391440.262710:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.262773:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169592448 00000100:00100000:3.0:1790391440.262793:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169592448 00000100:00100000:1.0:1790391440.262936:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169592704 00000100:00100000:1.0:1790391440.262959:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169592704 00000100:00100000:3.0:1790391440.262973:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 288 00000100:00100000:3.0:1790391440.262992:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:2384:x1877361169592448:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391440.263043:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 137 00000100:00100000:1.0:1790391440.263061:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169592704:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391440.263120:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:2384:x1877361169592448:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 133us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391440.263131:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 288 00000100:00100000:1.0:1790391440.263172:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169592704:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 115us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391440.263181:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 137 00000100:00080000:2.0:1790391440.263403:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391440.263411:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391440.282540:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391440.284839:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169592960 00000100:00100000:1.0:1790391440.284861:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169592960 00000100:00080000:2.0:1790391440.285112:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391440.285193:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 289 00000100:00100000:1.0:1790391440.285207:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169592960:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391440.285339:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169592960:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 134us (2813us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391440.285347:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 289 00000100:00100000:3.0:1790391440.297543:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.297601:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.297647:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.297732:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391440.297764:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169592832 00000100:00100000:2.0:1790391440.297778:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169592832 00000100:00100000:3.0:1790391440.297800:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169592576 00000100:00100000:3.0:1790391440.297804:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169592576 00000100:00100000:3.0:1790391440.297848:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169593088 00000100:00100000:3.0:1790391440.297851:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169593088 00000100:00100000:2.0:1790391440.297854:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 138 00000100:00100000:2.0:1790391440.297865:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169592832:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391440.297870:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 290 00000100:00100000:3.0:1790391440.297905:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169592576:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391440.298021:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 291 00000100:00100000:0.0:1790391440.298032:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169593088:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391440.298111:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169592320 00000100:00100000:1.0:1790391440.298117:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169592320 00000100:00100000:1.0:1790391440.298159:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 383 00000100:00100000:1.0:1790391440.298167:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529e8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169592320:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391440.298248:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169592832:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 384us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391440.298256:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 138 00000100:00080000:2.0:1790391440.298280:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391440.298286:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391440.298444:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169592576:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 566us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391440.298452:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 290 00000100:00100000:0.0:1790391440.301305:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169593088:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 3251us (3548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391440.301326:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 291 00000100:00100000:1.0:1790391440.301536:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529e8e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169592320:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 3365us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391440.301558:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 383 00010000:00010000:2.0:1790391440.330364:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391440.392265:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391440.392300:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186446464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391440.392407:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391440.392528:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186446592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391440.392566:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1790391440.392643:0:8832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353759764199ns, next at 354759760919ns, rc = 0 00000100:00100000:3.0:1790391440.392656:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186446464 00000100:00100000:3.0:1790391440.392666:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186446464 00000100:00100000:3.0:1790391440.392844:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1790391440.392895:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391440.393152:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790391440.393162:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186446720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391440.393187:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186446464:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391440.393195:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391440.393223:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186446592 00000100:00100000:2.0:1790391440.393227:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186446592 00002000:00000024:3.0:1790391440.393228:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391440.393261:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790391440.393267:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186446592:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391440.393283:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186446464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (877us total) trans 0 rc 0/0 00000004:00000024:2.0:1790391440.393296:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391440.393334:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186446720 00000100:00100000:0.0:1790391440.393339:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186446720 00000100:00080000:1.0:1790391440.395337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391440.397008:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186446464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391440.398565:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790391440.399307:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186446592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6030us (6730us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391440.399319:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790391440.399769:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790391440.399795:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186446720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391440.399917:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391440.400013:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186446720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 231us (6816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391440.400021:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790391440.401042:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186446720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391440.401068:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186446592:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1790391440.797016:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391440.797030:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391440.797068:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1790391440.797079:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391440.797272:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822e8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186446848:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391440.798116:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0b410c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391440.807059:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.807313:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169593216 00000100:00100000:3.0:1790391440.807323:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169593216 00000100:00100000:3.0:1790391440.807385:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 124 00000100:00100000:3.0:1790391440.807396:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+62:11389:x1877361169593216:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790391440.807430:0:10091:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790391440.807636:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+62:11389:x1877361169593216:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 241us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391440.807659:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 124 00000100:00100000:1.0:1790391440.808071:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822e8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186446848:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790391440.820034:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391440.820297:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169593344 00000100:00100000:1.0:1790391440.820308:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169593344 00000100:00100000:1.0:1790391440.820382:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 125 00000100:00100000:1.0:1790391440.820392:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:11389:x1877361169593344:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790391440.820471:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1832 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820486:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1832 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820500:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1832 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820547:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1839 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820554:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1839 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820560:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1839 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820580:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820589:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820595:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391440.820645:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790391440.820660:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391440.820673:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820685:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1832 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820692:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1832 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820700:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1832 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820716:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391440.820720:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1832 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820728:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1832 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820740:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:1.0:1790391440.820743:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391440.820748:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1832 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820754:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e1832 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820768:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1839 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820775:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1839 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820781:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1839 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820786:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391440.820788:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1839 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820793:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1839 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820809:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9e5283a48300) 00010000:00010000:1.0:1790391440.820812:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391440.820814:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1839 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820819:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e1839 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820831:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820837:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820842:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820846:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391440.820849:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820855:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820862:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391440.820864:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391440.820866:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391440.820871:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1840 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391440.821147:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:11389:x1877361169593344:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 Request processed in 745us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391440.821163:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 125 00000100:00100000:0.0:1790391440.832272:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.832393:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169593600 00000100:00100000:3.0:1790391440.832407:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169593600 00000100:00100000:3.0:1790391440.832536:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 126 00000100:00100000:3.0:1790391440.832550:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+61:11389:x1877361169593600:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391440.832582:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391440.832614:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1847 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b029d expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.832762:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e184e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.832783:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e184e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.832797:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e184e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391440.832821:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790391440.832984:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e184e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.832994:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e184e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.833001:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e184e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.833021:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391440.833049:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e184e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.833058:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e184e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.833073:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:3.0:1790391440.833077:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790391440.833082:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e184e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.833090:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e184e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.833145:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1847 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b029d expref: 63 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.833157:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:3.0:1790391440.833160:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391440.833164:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1847 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b029d expref: 63 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.833174:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763da00, rc 0) 00000100:00100000:3.0:1790391440.833255:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+62:11389:x1877361169593600:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 708us (1000us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1790391440.833264:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 126 00000100:00100000:2.0:1790391440.840553:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391440.841074:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169593728 00000100:00100000:0.0:1790391440.841087:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169593728 00000100:00100000:0.0:1790391440.841187:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 127 00000100:00100000:0.0:1790391440.841200:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+62:11389:x1877361169593728:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790391440.841254:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790391440.841439:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+62:11389:x1877361169593728:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 241us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391440.841447:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 127 00000100:00100000:0.0:1790391440.846066:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.846694:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169593984 00000100:00100000:3.0:1790391440.846708:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169593984 00000100:00100000:3.0:1790391440.846794:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 128 00000100:00100000:3.0:1790391440.846811:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+62:11389:x1877361169593984:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391440.846865:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391440.846870:0:10091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790391440.846949:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e17ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0281 expref: 62 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.846979:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:3.0:1790391440.846986:0:10091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391440.847004:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e185c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02a4 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391440.847758:0:10091:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1790391440.851844:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1863 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.851869:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.851904:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391440.854999:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e185c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02a4 expref: 64 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391440.855088:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1863 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02a4 expref: 63 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391440.855101:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbb00) 00010000:00010000:2.0:1790391440.855104:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391440.855109:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c800, rc 0) 00000100:00100000:2.0:1790391440.855775:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+63:11389:x1877361169593984:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 8963us (9719us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1790391440.855789:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 128 00000100:00100000:2.0:1790391440.873105:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391440.880441:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169594240 00000100:00100000:0.0:1790391440.880462:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169594240 00000100:00100000:0.0:1790391440.880553:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 129 00000100:00100000:0.0:1790391440.880565:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+63:11389:x1877361169594240:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790391440.880634:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391440.880681:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1863 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02a4 expref: 63 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880704:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbb00) 00010000:00010000:0.0:1790391440.880730:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391440.880753:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1871 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880766:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1871 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880776:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1871 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880788:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1878 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x265abb04 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880794:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1878 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x265abb04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880799:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1878 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x265abb04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880948:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1871 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880957:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1871 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880964:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1871 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880969:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391440.880980:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1871 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880989:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1871 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.880998:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:0.0:1790391440.881001:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391440.881004:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1871 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.881011:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1871 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.881022:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1878 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x265abb04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.881028:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1878 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x265abb04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.881034:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1878 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x265abb04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.881039:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391440.881041:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1878 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x265abb04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.881047:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1878 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x265abb04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.881054:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x265abb04 (ffff9e5182c85300) 00010000:00010000:0.0:1790391440.881057:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391440.881066:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1878 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x265abb04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.881072:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e1878 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x265abb04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391440.881191:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+62:11389:x1877361169594240:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 627us (8094us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391440.881199:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 129 00000100:00100000:2.0:1790391440.883856:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.884067:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169594368 00000100:00100000:3.0:1790391440.884080:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169594368 00000100:00100000:3.0:1790391440.884164:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 130 00000100:00100000:3.0:1790391440.884176:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+62:11389:x1877361169594368:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391440.884206:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391440.884247:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e187f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.884303:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.884326:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.884342:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.884491:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e187f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ab expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.884620:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ab expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.884631:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:3.0:1790391440.884634:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391440.884638:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d600, rc 0) 00000100:00100000:3.0:1790391440.884732:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+63:11389:x1877361169594368:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 558us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391440.884740:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 130 00000100:00100000:1.0:1790391440.889529:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391440.889676:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169594624 00000100:00100000:0.0:1790391440.889690:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169594624 00000100:00100000:0.0:1790391440.889771:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 131 00000100:00100000:0.0:1790391440.889782:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+63:11389:x1877361169594624:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790391440.889950:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.889970:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.889985:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391440.890369:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:0.0:1790391440.890437:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005275d28e reply state 00000000d1e23d7e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.890450:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.890456:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:0.0:1790391440.890458:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790391440.890479:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790391440.890608:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:11389:x1877361169594624:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 826us (1206us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1790391440.890617:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 131 00000100:00100000:0.0:1790391440.894773:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.894922:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169594752 00000100:00100000:3.0:1790391440.894946:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169594752 00000100:00100000:3.0:1790391440.895020:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 132 00000100:00100000:3.0:1790391440.895033:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:11389:x1877361169594752:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391440.895067:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391440.895095:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1894 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.895179:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1894 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b2 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.895221:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1894 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b2 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.895249:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:3.0:1790391440.895252:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391440.895257:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763dc00, rc 0) 00000100:00100000:3.0:1790391440.895514:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:11389:x1877361169594752:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 482us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391440.895522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 132 00000100:00100000:1.0:1790391440.907219:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.908196:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169594880 00000100:00100000:3.0:1790391440.908212:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169594880 00000100:00100000:3.0:1790391440.908430:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00100000:3.0:1790391440.908444:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169594880:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790391440.908778:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2383:x1877361169594880:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 336us (1573us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790391440.908788:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00100000:1.0:1790391440.918572:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391440.918735:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169595136 00000100:00100000:2.0:1790391440.918750:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169595136 00000100:00100000:2.0:1790391440.918829:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:2.0:1790391440.918844:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:11389:x1877361169595136:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790391440.919221:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:11389:x1877361169595136:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 379us (668us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1790391440.919230:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:0.0:1790391440.924121:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.925767:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169595392 00000100:00100000:3.0:1790391440.925788:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169595392 00000100:00100000:3.0:1790391440.925945:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 133 00000100:00100000:3.0:1790391440.925959:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:11389:x1877361169595392:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790391440.926142:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:11389:x1877361169595392:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 186us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391440.926151:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 133 00000100:00100000:1.0:1790391440.931637:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391440.931794:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169595520 00000100:00100000:2.0:1790391440.931813:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169595520 00000100:00100000:2.0:1790391440.932053:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 134 00000100:00100000:2.0:1790391440.932067:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:11389:x1877361169595520:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391440.932097:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391440.932127:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e189b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02b9 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391440.932225:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e18a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391440.932242:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e18a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391440.932257:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e18a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391440.932331:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391440.932359:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e18a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391440.932393:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e189b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b9 expref: 69 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391440.932450:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e18a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b9 expref: 68 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391440.932460:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:2.0:1790391440.932464:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790391440.932468:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d800, rc 0) 00000100:00100000:2.0:1790391440.932555:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+68:11389:x1877361169595520:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 491us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391440.932563:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 134 00000100:00100000:1.0:1790391440.939082:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391440.939334:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169595648 00000100:00100000:0.0:1790391440.939350:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169595648 00000100:00100000:0.0:1790391440.939445:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:0.0:1790391440.939457:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2383:x1877361169595648:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391440.939485:0:9796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391440.939514:0:9796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e18a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02c0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391440.939563:0:9796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab73491, blocks: 0x0 00010000:00010000:0.0:1790391440.939593:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1790391440.939598:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391440.939610:0:9796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e18a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c0 expref: 10 pid: 9796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.939634:0:9796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e18a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c0 expref: 10 pid: 9796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.939651:0:9796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefa00, rc 0) 00000100:00100000:0.0:1790391440.939792:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:2383:x1877361169595648:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 336us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391440.939800:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:0.0:1790391440.945810:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.946141:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169595904 00000100:00100000:3.0:1790391440.946177:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169595904 00000100:00100000:0.0:1790391440.946507:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 135 00000100:00100000:0.0:1790391440.946595:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+68:11389:x1877361169595904:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790391440.946810:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+68:11389:x1877361169595904:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 291us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391440.946819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 135 00000100:00100000:2.0:1790391440.951919:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391440.952136:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169596032 00000100:00100000:3.0:1790391440.952152:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169596032 00000100:00100000:3.0:1790391440.952233:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:3.0:1790391440.952246:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:11389:x1877361169596032:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391440.952273:0:10505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391440.952314:0:10505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02c7 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.952356:0:10505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e18a9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c0 expref: 11 pid: 9796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.952368:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391440.952373:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391440.952380:0:10505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 11 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.952442:0:10505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e18a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c0 expref: 11 pid: 9796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.952461:0:10505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e18a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c0 expref: 11 pid: 9796 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391440.952479:0:10505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10505:1877361186446976:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391440.952624:0:10505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183880f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391440.957988:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391440.958166:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169596160 00000100:00100000:0.0:1790391440.958179:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169596160 00010000:00010000:0.0:1790391440.958238:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e18a9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c0 expref: 12 pid: 9796 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391440.958307:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 72 00000100:00100000:0.0:1790391440.958319:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+12:2383:x1877361169596160:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391440.958339:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391440.958369:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e18a9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c0 expref: 12 pid: 9796 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.958385:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e18a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c0 expref: 12 pid: 9796 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.958425:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391440.958431:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391440.958443:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 12 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.958455:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 12 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391440.958700:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 12 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391440.958722:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1877361186447104:192.168.202.28@tcp:105: 00010000:00010000:3.0:1790391440.959012:0:10505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e18a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c0 expref: 12 pid: 9796 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391440.959045:0:10505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10505:1877361186446976:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391440.959077:0:10505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 11 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.959089:0:10505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c200, rc 0) 00000100:00100000:0.0:1790391440.959187:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391440.962057:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:11389:x1877361169596032:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 9791us (10170us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391440.962075:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:1.0:1790391440.969234:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1877361186447104:192.168.202.28@tcp:105: 00010000:00010000:1.0:1790391440.969278:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391440.969378:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:2383:x1877361169596160:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 11059us (11406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391440.969393:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 72 00000100:00100000:0.0:1790391440.971719:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391440.971777:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169596288 00000100:00100000:2.0:1790391440.971796:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169596288 00002000:00100000:2.0:1790391440.971874:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9e51839f5880 x1877361169596288/t0(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:306/0 lens 504/0 e 0 to 0 dl 1790391451 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790391440.971928:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e51839f5880 with x1877361169596288 ext(0->12) 00002000:00010000:2.0:1790391440.971947:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e51839f5880 00000100:00100000:2.0:1790391440.971991:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:2.0:1790391440.972008:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:2383:x1877361169596288:12345-192.168.202.28@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790391440.977470:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+12:2383:x1877361169596288:12345-192.168.202.28@tcp:4:lhsmtool_posix.0 Request processed in 5455us (5751us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790391440.977487:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 2 00002000:00100000:2.0:1790391440.977505:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9e51839f5880 x1877361169596288/t4294967309(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:306/0 lens 504/448 e 0 to 0 dl 1790391451 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790391440.977868:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e51839f5880 with x1877361169596288 ext(0->12) 00002000:00010000:2.0:1790391440.978230:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e51839f5880 00000100:00100000:0.0:1790391440.989850:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391440.990011:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169596416 00000100:00100000:2.0:1790391440.990021:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169596416 00000100:00100000:2.0:1790391440.990091:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 136 00000100:00100000:2.0:1790391440.990103:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+68:11389:x1877361169596416:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790391440.997998:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1790391440.998026:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1790391440.998243:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:3.0:1790391440.998645:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998673:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998681:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998797:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391440.998802:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998811:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998829:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e51821bab00) 00010000:00010000:3.0:1790391440.998832:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391440.998837:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998861:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e15b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998946:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998953:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998958:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998961:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391440.998964:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998970:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998978:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e52b9b6c700) 00010000:00010000:3.0:1790391440.998980:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391440.998983:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.998989:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e165d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999010:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999017:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999030:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999035:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391440.999038:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999044:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999052:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e52b9b6c000) 00010000:00010000:3.0:1790391440.999054:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391440.999057:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999062:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e16db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999074:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999081:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999086:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999092:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391440.999095:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999110:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999119:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e52b9b6c000) 00010000:00010000:3.0:1790391440.999121:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391440.999124:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999130:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e16fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999145:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999152:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999157:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999162:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391440.999164:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999171:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391440.999180:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:3.0:1790391440.999183:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391440.999186:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391440.999288:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391440.999307:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186447232:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790391440.999448:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391441.000497:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e17d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.001481:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.001494:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.001500:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.001505:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391441.001509:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.001515:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.001531:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:3.0:1790391441.001534:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790391441.001550:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.001556:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e188d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391441.001594:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186447232 00000100:00100000:3.0:1790391441.001607:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186447232 00000100:00100000:3.0:1790391441.001674:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790391441.001684:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186447232:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790391441.002650:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391441.002667:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186447360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790391441.002745:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1790391441.003833:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e51822df9c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1790391441.003840:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e52bfa24000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e51822df240 00000020:00080000:0.0:1790391441.003844:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e52bfa24400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e518209e800 00000004:00080000:0.0:1790391441.003871:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1790391441.003918:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e5183898540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1790391441.003921:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e52b7641a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e51838986c0 00000020:00080000:0.0:1790391441.003924:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e52b7641b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5281496a00 00000020:00080000:1.0:1790391441.004058:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1790391441.004128:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00002000:00080000:2.0:1790391441.007237:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1790391441.007274:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.007300:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e166b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b021f expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.007309:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1790391441.007313:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391441.007318:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.007363:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e166b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b021f expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.007383:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e166b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b021f expref: 11 pid: 8428 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391441.007413:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1877361186447488:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391441.007514:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e967c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391441.019626:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186447360 00000100:00100000:3.0:1790391441.019642:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186447360 00000100:00100000:3.0:1790391441.020907:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790391441.020921:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186447360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790391441.020967:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1790391441.021005:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6ab7348f, atime: 0x6ab7348f, ctime: 0x6ab7348f, blocks: 0x8 00010000:00010000:3.0:1790391441.021014:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e18be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.021031:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1790391441.021036:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391441.021042:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e18be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790391441.021261:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790391441.023443:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e18be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.023467:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e18be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.023476:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e18be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.023511:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790391441.023781:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1877361186447360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2860us (21032us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790391441.023792:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391441.023999:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:11389:x1877361169596416:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 Request processed in 33895us (34157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391441.024009:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 136 00000004:00080000:1.0:1790391441.024130:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e518382b480/2, rc 0, transno 4294967305 00000100:00100000:1.0:1790391441.024138:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186447360:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790391441.024523:0:13724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391441.024532:0:13724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e18be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.024543:0:13724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391441.024548:0:13724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e18be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.024568:0:13724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e18be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.024586:0:13724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e18be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.024593:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006418eb9d/0x2b1b7949f13e18be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.024629:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391441.024632:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391441.024634:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391441.025387:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1877361186447488:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391441.025414:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391441.035980:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391441.036015:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391441.036112:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169596544 00000100:00100000:0.0:1790391441.036123:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169596544 00010000:00010000:0.0:1790391441.036179:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e166b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b021f expref: 12 pid: 8428 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391441.036228:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 73 00000100:00100000:0.0:1790391441.036237:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+12:2384:x1877361169596544:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391441.036257:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391441.036263:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e166b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b021f expref: 12 pid: 8428 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.036279:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e166b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b021f expref: 12 pid: 8428 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.036334:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e166b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b021f expref: 12 pid: 8428 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.036353:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391441.036357:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391441.036363:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.036373:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.036410:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391441.036471:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:2384:x1877361169596544:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 235us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391441.036479:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 73 00000100:00100000:1.0:1790391441.036702:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169596672 00000100:00100000:1.0:1790391441.036708:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169596672 00000100:00100000:1.0:1790391441.036751:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 50 00000100:00100000:1.0:1790391441.036760:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:2383:x1877361169596672:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1790391441.037734:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.037750:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.037760:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.037768:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.037785:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391441.038904:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391441.038917:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391441.038963:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391441.038969:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391441.038981:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391441.039003:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391441.039011:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088b546fc/0x2b1b7949f13e18b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391441.039039:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391441.039041:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391441.039043:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391441.039300:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186447232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37613us (39848us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790391441.039311:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:1.0:1790391441.039536:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5183b08380/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790391441.039555:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186447232:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1790391441.041854:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1790391441.041932:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1790391441.042137:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169596672:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 Request processed in 5366us (6108us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391441.042150:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 50 00000100:00100000:2.0:1790391441.054414:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391441.054550:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169596928 00000100:00100000:3.0:1790391441.054561:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169596928 00000100:00100000:3.0:1790391441.054645:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 137 00000100:00100000:3.0:1790391441.054663:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:11389:x1877361169596928:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790391441.054729:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391441.054759:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e18a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b9 expref: 16 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.054783:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:3.0:1790391441.054789:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391441.054820:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.054847:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.054857:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790391441.055049:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbbbbffe reply state 000000000c5f2100 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.055062:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.055069:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:3.0:1790391441.055071:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391441.055074:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391441.055176:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:11389:x1877361169596928:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 520us (773us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1790391441.055184:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 137 00000100:00100000:2.0:1790391441.062972:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391441.063277:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169597056 00000100:00100000:3.0:1790391441.063292:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169597056 00000100:00100000:3.0:1790391441.063514:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:3.0:1790391441.063528:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169597056:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790391441.063754:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790391441.063758:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790391440 00002000:00010000:3.0:1790391441.063761:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790391439 00002000:00010000:3.0:1790391441.063764:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790391441 -> 1790391440 00002000:00010000:3.0:1790391441.063767:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1790391441.063956:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169597056:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 430us (1004us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790391441.063988:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:1.0:1790391441.067251:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391441.067355:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169597312 00000100:00100000:3.0:1790391441.067367:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169597312 00000100:00100000:3.0:1790391441.067444:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 138 00000100:00100000:3.0:1790391441.067456:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:11389:x1877361169597312:12345-192.168.202.28@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790391441.067546:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.067568:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ab expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.067579:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.067616:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ab expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.067628:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ab expref: 17 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391441.067641:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186447616:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391441.067750:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51838803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391441.072558:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391441.072758:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169597440 00000100:00100000:1.0:1790391441.072770:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169597440 00010000:00010000:1.0:1790391441.072825:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ab expref: 18 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391441.072928:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 74 00000100:00100000:1.0:1790391441.072950:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:2384:x1877361169597440:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391441.072970:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391441.072979:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ab expref: 18 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391441.072996:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ab expref: 18 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391441.073025:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:1.0:1790391441.073031:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391441.073043:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391441.073052:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391441.073073:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391441.073135:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:2384:x1877361169597440:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 197us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391441.073143:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 74 00010000:00010000:3.0:1790391441.073323:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1886 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ab expref: 17 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391441.073343:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186447616:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391441.073378:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.073388:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.073394:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.073441:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.073447:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.073454:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.073461:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391441.073466:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.073474:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.073483:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:3.0:1790391441.073486:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790391441.073489:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.073495:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18cc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391441.073560:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:11389:x1877361169597312:12345-192.168.202.28@tcp:55:lhsmtool_posix.0 Request processed in 6105us (6323us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790391441.073569:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 138 00000100:00100000:1.0:1790391441.077390:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391441.081221:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169597568 00000100:00100000:0.0:1790391441.081245:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169597568 00000100:00100000:0.0:1790391441.081350:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:0.0:1790391441.081364:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169597568:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790391441.081698:0:9796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.081726:0:9796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 7 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.081764:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391441.081770:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790391441.081776:0:9796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.081830:0:9796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 7 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.081849:0:9796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 7 pid: 10505 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391441.081866:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9796:1877361186447744:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391441.082139:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822dfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391441.094148:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391441.095112:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9796:1877361186447744:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391441.095155:0:9796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391441.095597:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169597696 00000100:00100000:2.0:1790391441.095607:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169597696 00010000:00010000:2.0:1790391441.095666:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 8 pid: 10505 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391441.095851:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 75 00000100:00100000:2.0:1790391441.095865:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169597696:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391441.095947:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391441.095979:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 8 pid: 10505 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.095993:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 8 pid: 10505 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.096023:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008445c133/0x2b1b7949f13e18b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02c7 expref: 8 pid: 10505 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.096044:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391441.096049:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391441.096056:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.096067:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.096103:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391441.096180:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169597696:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 317us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391441.096188:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 75 00010000:00010000:0.0:1790391441.096258:0:9796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.096269:0:9796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.096312:0:9796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.096322:0:9796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.096346:0:9796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.096353:0:9796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391441.096359:0:9796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.096369:0:9796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.096383:0:9796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.096391:0:9796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003807f832/0x2b1b7949f13e18d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391441.096463:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169597568:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 Request processed in 15101us (19092us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391441.096472:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:2.0:1790391441.100673:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391441.100785:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169597952 00000100:00100000:3.0:1790391441.100799:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169597952 00000100:00100000:3.0:1790391441.101108:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 139 00000100:00100000:3.0:1790391441.101122:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:11389:x1877361169597952:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790391441.101231:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.101255:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0273 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.101267:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.101314:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0273 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.101332:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0273 expref: 16 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391441.101377:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186447872:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391441.101503:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51838803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391441.105335:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186447872:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391441.105379:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391441.107570:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391441.107807:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169598080 00000100:00100000:0.0:1790391441.107821:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169598080 00010000:00010000:0.0:1790391441.107942:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0273 expref: 17 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391441.107992:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 76 00000100:00100000:0.0:1790391441.108032:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:2384:x1877361169598080:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391441.108056:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391441.108066:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0273 expref: 17 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.108083:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0273 expref: 17 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.108119:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e17c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0273 expref: 17 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.108145:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391441.108153:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e182b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0296 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.108168:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.108180:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.108190:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.108229:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391441.108316:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:2384:x1877361169598080:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 287us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391441.108325:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 76 00010000:00010000:3.0:1790391441.108606:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.108617:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.108856:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.108870:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1894 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b2 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.109093:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.109137:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1894 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b2 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.109154:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1894 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b2 expref: 16 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391441.109171:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186448000:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391441.109268:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183880600 going to sleep for 11 seconds 00000100:00100000:1.0:1790391441.117043:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391441.117287:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169598208 00000100:00100000:2.0:1790391441.117312:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169598208 00010000:00010000:2.0:1790391441.117374:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1894 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b2 expref: 17 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391441.117457:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 77 00000100:00100000:2.0:1790391441.117470:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:2383:x1877361169598208:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391441.117490:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391441.117499:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1894 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b2 expref: 17 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.117526:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1894 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b2 expref: 17 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.117561:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:2.0:1790391441.117566:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.117579:0:10388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.117588:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.117615:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391441.117694:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:2383:x1877361169598208:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 226us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391441.117702:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 77 00010000:00010000:3.0:1790391441.119840:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1894 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02b2 expref: 16 pid: 6513 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391441.119872:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa6ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186448000:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391441.120200:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.120270:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.120279:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391441.120780:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1790391441.121123:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1790391441.121170:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1790391441.121290:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186448128:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790391441.121709:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391441.121813:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e9673c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391441.121864:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186448128 00000100:00100000:1.0:1790391441.122020:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186448128 00000100:00100000:1.0:1790391441.122140:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790391441.122150:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1877361186448128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790391441.122279:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1877361186448128:12345-0@lo:1000:mdt00_000.0 Request processed in 130us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391441.122288:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790391441.122361:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1790391441.122375:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1790391441.122419:0:6512:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e5183b08380 x1877361186447232/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790391456 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391441.122434:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186448128:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790391441.122601:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1790391441.122671:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51839f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186448256:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790391441.122727:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391441.123121:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295584780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391441.123208:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186448256 00000100:00100000:2.0:1790391441.123216:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186448256 00000100:00100000:2.0:1790391441.123252:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790391441.123260:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51833c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1877361186448256:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790391441.123417:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51833c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6512:x1877361186448256:12345-0@lo:1000:mdt00_000.0 Request processed in 147us (680us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790391441.123424:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790391441.123637:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51839f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186448256:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790391441.123685:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123697:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123706:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123712:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391441.123718:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123728:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123748:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:0.0:1790391441.123751:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391441.123757:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123780:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e18e1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123812:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123817:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123824:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123829:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391441.123832:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123838:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123845:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391441.123847:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391441.123855:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e182b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0296 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123868:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e182b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0296 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123906:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e182b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0296 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.123964:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e182b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0296 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391441.123978:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186448384:192.168.202.28@tcp:105: 00000100:00100000:0.0:1790391441.124056:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5289676180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391441.129381:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391441.129477:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169598336 00000100:00100000:2.0:1790391441.129489:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169598336 00000100:00100000:2.0:1790391441.129574:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:2.0:1790391441.129588:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:11387:x1877361169598336:12345-192.168.202.28@tcp:49:lfs.0 00000100:00100000:2.0:1790391441.129781:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:11387:x1877361169598336:12345-192.168.202.28@tcp:49:lfs.0 Request processed in 195us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391441.129790:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:0.0:1790391441.129928:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186448384:192.168.202.28@tcp:105: 00010000:00010000:0.0:1790391441.129977:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.129991:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1824 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130037:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130056:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130073:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130087:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130095:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130104:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130137:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391441.130144:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130154:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130171:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391441.130175:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391441.130179:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130185:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130196:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130203:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130209:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130214:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391441.130218:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130224:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130246:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391441.130248:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790391441.130252:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.130257:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e18da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391441.130459:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:11389:x1877361169597952:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 29339us (29803us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1790391441.130470:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 139 00000020:00080000:0.0:1790391441.130475:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790391441.130785:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790391441.130792:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391441.131372:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790391441.131388:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790391441.136592:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391441.136829:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169598592 00000100:00100000:3.0:1790391441.136843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169598592 00000100:00100000:3.0:1790391441.136971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:3.0:1790391441.136984:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:11389:x1877361169598592:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790391441.137345:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790391441.137386:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1790391441.137665:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.137688:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.137704:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.137714:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.137721:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.137728:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391441.137775:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391441.138030:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391441.138040:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.138047:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763dc00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391441.138052:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.138063:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.138078:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:0.0:1790391441.138082:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790391441.138088:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.138095:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e18ef lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.138126:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391441.138128:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391441.138130:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391441.138777:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:11389:x1877361169598592:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 1786us (2193us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1790391441.138789:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 32 00000020:00080000:3.0:1790391441.138798:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790391441.143262:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391441.143370:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169598848 00000100:00100000:2.0:1790391441.143403:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169598848 00000100:00100000:2.0:1790391441.143491:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 140 00000100:00100000:2.0:1790391441.143502:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:11387:x1877361169598848:12345-192.168.202.28@tcp:58:lfs.0 00000040:00080000:2.0:1790391441.143746:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1790391441.143855:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:11387:x1877361169598848:12345-192.168.202.28@tcp:58:lfs.0 Request processed in 353us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391441.143864:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 140 00000100:00100000:1.0:1790391441.194357:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391441.194720:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169598976 00000100:00100000:0.0:1790391441.194734:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169598976 00000100:00100000:0.0:1790391441.194828:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 141 00000100:00100000:0.0:1790391441.194841:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:11391:x1877361169598976:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391441.194917:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391441.194957:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.195052:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e18fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.195070:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e18fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.195086:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e18fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.195104:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1904 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.195111:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.195119:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.195219:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.195249:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b028f expref: 22 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.195259:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.196677:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b028f expref: 22 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.196707:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b028f expref: 22 pid: 10091 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391441.196730:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186448512:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391441.196904:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5289676180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391441.212285:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391441.212404:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169599232 00000100:00100000:3.0:1790391441.212432:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169599232 00000100:00100000:3.0:1790391441.212524:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:3.0:1790391441.212538:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:6155:x1877361169599232:12345-192.168.202.28@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790391441.212852:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:6155:x1877361169599232:12345-192.168.202.28@tcp:35:ldlm_bl.0 Request processed in 315us (584us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1790391441.212860:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:0.0:1790391441.213927:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186448512:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391441.213977:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391441.215314:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391441.215407:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169599360 00000100:00100000:0.0:1790391441.215433:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169599360 00010000:00010000:0.0:1790391441.215483:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b028f expref: 24 pid: 10091 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391441.215528:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 78 00000100:00100000:0.0:1790391441.215536:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:2384:x1877361169599360:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391441.215554:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391441.215578:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b028f expref: 24 pid: 10091 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.215590:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b028f expref: 24 pid: 10091 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.215614:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1816 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b028f expref: 24 pid: 10091 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.215634:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391441.215641:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.215652:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.215662:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391441.215705:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391441.215780:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:2384:x1877361169599360:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 243us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391441.215788:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 78 00010000:00010000:2.0:1790391441.216000:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216010:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391441.216085:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790391441.216091:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391441.216117:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216137:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216151:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e18fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216158:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e18fd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216166:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e18fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216172:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eeee00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391441.216177:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e18fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216199:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e18fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216210:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:2.0:1790391441.216213:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391441.216218:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e18fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216225:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e18fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216240:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216245:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1904 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216251:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216257:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391441.216259:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216264:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1904 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216271:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e5182c83200) 00010000:00010000:2.0:1790391441.216273:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391441.216276:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1904 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216293:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1904 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216342:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e18f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ce expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216358:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ce expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391441.216366:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:2.0:1790391441.216369:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391441.216371:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee400, rc 0) 00000100:00100000:2.0:1790391441.216944:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:11391:x1877361169598976:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 21570us (22068us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391441.216956:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 141 00010000:00010000:2.0:1790391441.357114:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391441.956515:0:14307:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391441.956526:0:14307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391441.956557:0:14307:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790391441.956563:0:14307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1790391442.184307:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391442.184316:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391442.184336:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790391442.184345:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391442.184471:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186448640:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391442.184623:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0b41e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391442.196419:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186448640:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790391442.201128:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391442.201271:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169599488 00000100:00100000:2.0:1790391442.201282:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169599488 00000100:00100000:2.0:1790391442.201354:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 142 00000100:00100000:2.0:1790391442.201366:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:11403:x1877361169599488:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790391442.201401:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790391442.201547:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:11403:x1877361169599488:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 184us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391442.201555:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 142 00000100:00080000:0.0:1790391442.201647:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391442.208145:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391442.208242:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169599744 00000100:00100000:2.0:1790391442.208252:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169599744 00000100:00100000:2.0:1790391442.208312:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 143 00000100:00100000:2.0:1790391442.208321:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:11403:x1877361169599744:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391442.208342:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391442.208364:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1912 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.208484:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1919 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.208500:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1919 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.208524:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1919 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391442.208536:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790391442.208637:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1912 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02d5 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.208653:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1919 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02d5 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.208661:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:2.0:1790391442.208664:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391442.208668:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c200, rc 0) 00000100:00100000:2.0:1790391442.208737:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:11403:x1877361169599744:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 416us (601us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1790391442.208762:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 143 00000100:00100000:1.0:1790391442.214664:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391442.214746:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169600000 00000100:00100000:2.0:1790391442.214757:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169600000 00000100:00100000:2.0:1790391442.214825:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 144 00000100:00100000:2.0:1790391442.214835:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:11403:x1877361169600000:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790391442.214983:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.215001:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.215013:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.215163:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.215170:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1927 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.215177:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1927 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.215182:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391442.215187:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1927 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.215193:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1927 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.215224:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:2.0:1790391442.215227:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391442.215232:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1927 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.215238:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1927 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391442.215373:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:11403:x1877361169600000:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 538us (719us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1790391442.215381:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 144 00000040:00080000:1.0:1790391442.215524:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391442.215528:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391442.216058:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790391442.216068:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790391442.220241:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391442.220352:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169600256 00000100:00100000:0.0:1790391442.220363:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169600256 00000100:00100000:0.0:1790391442.220427:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 34 00000100:00100000:0.0:1790391442.220436:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:11403:x1877361169600256:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790391442.220677:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+26:11403:x1877361169600256:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 235us (438us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1790391442.220700:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 34 00000100:00100000:0.0:1790391442.228304:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391442.228521:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169600384 00000100:00100000:2.0:1790391442.228532:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169600384 00000100:00100000:2.0:1790391442.228600:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:2.0:1790391442.228611:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+26:2381:x1877361169600384:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391442.228628:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391442.228652:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1919 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02d5 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391442.228672:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:2.0:1790391442.228678:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391442.228737:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:2381:x1877361169600384:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 128us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391442.228745:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 10 00010000:00010000:0.0:1790391442.376515:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391442.440206:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391442.440230:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186448768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391442.440313:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391442.440434:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186448768 00000100:00100000:3.0:1790391442.440442:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186448768 00000100:00100000:3.0:1790391442.440495:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790391442.440504:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186448768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391442.440536:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1790391442.440591:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186448768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391442.440598:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790391442.440767:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186448768:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790391443.404244:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790391443.786743:0:14359:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391443.786754:0:14359:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391443.786800:0:14359:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790391443.786809:0:14359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790391443.940716:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391443.943064:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169600640 00000100:00100000:2.0:1790391443.943081:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169600640 00000100:00100000:2.0:1790391443.943150:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 145 00000100:00100000:2.0:1790391443.943168:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:11423:x1877361169600640:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391443.943193:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391443.943216:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e192e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02dc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.943336:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e1935 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.943353:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e1935 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.943369:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e1935 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391443.943381:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790391443.943490:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e192e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02dc expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.943507:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e1935 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02dc expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.943517:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:2.0:1790391443.943520:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790391443.943524:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309dc00, rc 0) 00000100:00100000:2.0:1790391443.943588:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:11423:x1877361169600640:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 422us (2884us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1790391443.943596:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 145 00000100:00100000:1.0:1790391443.958658:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391443.958790:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169600768 00000100:00100000:2.0:1790391443.958799:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169600768 00000100:00100000:2.0:1790391443.958917:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 146 00000100:00100000:2.0:1790391443.958928:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:11423:x1877361169600768:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:2.0:1790391443.959003:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1943 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.959022:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.959035:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.959071:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.959079:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1943 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.959086:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.959092:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391443.959097:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.959105:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1943 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.959117:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:2.0:1790391443.959120:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391443.959125:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1943 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391443.959143:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1943 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391443.959218:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:11423:x1877361169600768:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 291us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391443.959226:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 146 00000100:00100000:1.0:1790391443.978762:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186448896:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.978831:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.978900:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186449408:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.978939:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.978961:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186449920:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.978983:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.978998:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186450432:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979017:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.979039:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790391443.979045:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186449280:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979068:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.979087:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186449792:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.979124:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186450304:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979143:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.979171:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186449024:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979194:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.979210:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186449536:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979229:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.979243:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186450048:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979259:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.979287:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790391443.979293:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186449152:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979314:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.979331:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186449664:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979350:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.979360:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186450176:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979389:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391443.979420:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186448896 00000100:00100000:1.0:1790391443.979427:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186448896 00000100:00100000:1.0:1790391443.979474:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1790391443.979483:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186448896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979529:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186448896:12345-0@lo:400:kworker.0 Request processed in 47us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.979536:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1790391443.979566:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186449408 00000100:00100000:1.0:1790391443.979570:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186449408 00000100:00100000:1.0:1790391443.979590:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186449152 00000100:00100000:1.0:1790391443.979593:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186449152 00000100:00100000:1.0:1790391443.979605:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790391443.979610:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186449408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979641:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186449408:12345-0@lo:400:kworker.0 Request processed in 30us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.979647:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1790391443.979658:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790391443.979663:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186449152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979692:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186449152:12345-0@lo:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.979708:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790391443.979726:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186449920 00000100:00100000:1.0:1790391443.979729:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186449920 00000100:00100000:1.0:1790391443.979760:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186450432 00000100:00100000:1.0:1790391443.979763:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186450432 00000100:00100000:1.0:1790391443.979776:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186449792 00000100:00100000:1.0:1790391443.979779:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186449792 00000100:00100000:1.0:1790391443.979790:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186450304 00000100:00100000:1.0:1790391443.979792:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186450304 00000100:00100000:1.0:1790391443.979805:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790391443.979811:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186449920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979843:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186449920:12345-0@lo:400:kworker.0 Request processed in 33us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.979849:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790391443.979860:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790391443.979865:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186450432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979929:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186450432:12345-0@lo:400:kworker.0 Request processed in 64us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.979935:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790391443.979944:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790391443.979949:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186449792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.979970:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186449792:12345-0@lo:400:kworker.0 Request processed in 22us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.979975:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790391443.979983:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790391443.979987:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186450304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980021:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186450304:12345-0@lo:400:kworker.0 Request processed in 33us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.980027:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790391443.980063:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186449280 00000100:00100000:1.0:1790391443.980066:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186449280 00000100:00100000:1.0:1790391443.980082:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186449024 00000100:00100000:1.0:1790391443.980085:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186449024 00000100:00100000:1.0:1790391443.980093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186449536 00000100:00100000:1.0:1790391443.980095:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186449536 00000100:00100000:1.0:1790391443.980106:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186450048 00000100:00100000:1.0:1790391443.980108:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186450048 00000100:00100000:1.0:1790391443.980117:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186449664 00000100:00100000:1.0:1790391443.980119:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186449664 00000100:00100000:1.0:1790391443.980128:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186450176 00000100:00100000:1.0:1790391443.980130:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186450176 00000100:00100000:1.0:1790391443.980142:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1790391443.980147:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186449280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980171:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186449280:12345-0@lo:400:kworker.0 Request processed in 24us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.980177:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1790391443.980186:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1790391443.980190:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186449024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980209:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186449024:12345-0@lo:400:kworker.0 Request processed in 19us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.980214:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1790391443.980222:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1790391443.980227:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186449536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980249:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186449536:12345-0@lo:400:kworker.0 Request processed in 22us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.980260:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1790391443.980269:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1790391443.980274:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186450048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980300:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186450048:12345-0@lo:400:kworker.0 Request processed in 25us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.980305:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1790391443.980315:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790391443.980320:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186449664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980343:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186449664:12345-0@lo:400:kworker.0 Request processed in 24us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.980348:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1790391443.980357:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790391443.980363:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186450176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980385:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186450176:12345-0@lo:400:kworker.0 Request processed in 22us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391443.980390:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:1.0:1790391443.980422:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391443.980427:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391443.980429:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391443.980432:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391443.980460:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186449152:0@lo:400:kworker.0 00010000:00080000:1.0:1790391443.980473:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183bbe680 x1877361186449664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391443.980481:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186449664:0@lo:400:kworker.0 00010000:00080000:1.0:1790391443.980500:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183bbc380 x1877361186450176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391443.980508:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186450176:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980518:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186449024:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980527:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186449536:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980535:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186450048:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980570:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186449280:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980578:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186449792:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980587:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186450304:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980596:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186448896:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980606:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186449408:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980615:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186449920:0@lo:400:kworker.0 00000100:00100000:1.0:1790391443.980623:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186450432:0@lo:400:kworker.0 00000100:00100000:0.0:1790391444.028086:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391444.028275:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169600896 00000100:00100000:1.0:1790391444.028285:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169600896 00000100:00100000:1.0:1790391444.028368:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:1.0:1790391444.028376:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169600896:12345-192.168.202.28@tcp:101:cat.0 00010000:00010000:1.0:1790391444.028393:0:10505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391444.028413:0:10505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000276f9c44/0x2b1b7949f13e194a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02e3 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391444.028454:0:10505:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6ab73490, atime: 0x6ab7348f, ctime: 0x6ab73490, blocks: 0x8 00010000:00010000:1.0:1790391444.028476:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1790391444.028481:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391444.028490:0:10505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000276f9c44/0x2b1b7949f13e194a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02e3 expref: 7 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790391444.028928:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790391444.029220:0:10505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000276f9c44/0x2b1b7949f13e194a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02e3 expref: 7 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391444.029242:0:10505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087800, rc 0) 00000100:00100000:2.0:1790391444.029472:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169600896:12345-192.168.202.28@tcp:101:cat.0 Request processed in 1093us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391444.029481:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:1.0:1790391444.034211:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391444.034291:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169601024 00000100:00100000:0.0:1790391444.034310:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169601024 00002000:00100000:0.0:1790391444.034359:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9e518404c000 x1877361169601024/t0(0) o3->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:310/0 lens 488/0 e 0 to 0 dl 1790391455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391444.034369:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e518404c000 with x1877361169601024 ext(0->4095) 00002000:00010000:0.0:1790391444.034375:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e518404c000 00000100:00100000:0.0:1790391444.034413:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:0.0:1790391444.034423:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2381:x1877361169601024:12345-192.168.202.28@tcp:3:cat.0 00000100:00100000:0.0:1790391444.035110:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2381:x1877361169601024:12345-192.168.202.28@tcp:3:cat.0 Request processed in 684us (904us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790391444.035119:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 3 00002000:00100000:0.0:1790391444.035128:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9e518404c000 x1877361169601024/t0(0) o3->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:310/0 lens 488/4536 e 0 to 0 dl 1790391455 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391444.035135:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e518404c000 with x1877361169601024 ext(0->4095) 00002000:00010000:0.0:1790391444.035150:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e518404c000 00000040:00080000:2.0:1790391444.296117:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790391444.296127:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391444.296147:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790391444.296157:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790391444.424523:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391444.488230:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391444.488252:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186450560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391444.488332:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391444.488564:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186450560 00000100:00100000:1.0:1790391444.488572:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186450560 00000100:00100000:1.0:1790391444.488621:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790391444.488629:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186450560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391444.488657:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391444.488704:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186450560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391444.488711:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790391444.488754:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186450560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391444.494984:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391444.495017:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186450688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391444.495090:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391444.495250:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186450688 00000100:00100000:1.0:1790391444.495260:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186450688 00000100:00100000:1.0:1790391444.495313:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790391444.495323:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1877361186450688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391444.495365:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391444.495412:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1877361186450688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391444.495419:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790391444.495619:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186450688:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1790391444.497385:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000040:00080000:2.0:1790391444.555561:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790391445.394060:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391445.394095:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391445.394151:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391445.394174:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391445.394195:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391445.394214:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391445.394237:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391445.394367:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169601152 00000100:00100000:0.0:1790391445.394378:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169601152 00000100:00100000:0.0:1790391445.394433:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 385 00000100:00100000:0.0:1790391445.394444:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169601152:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391445.394514:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169601152:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 71us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391445.394522:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 385 00000100:00100000:1.0:1790391445.394912:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169601408 00000100:00100000:1.0:1790391445.394918:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169601408 00000100:00100000:1.0:1790391445.394952:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169601920 00000100:00100000:1.0:1790391445.394955:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169601920 00000100:00100000:1.0:1790391445.394970:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169601280 00000100:00100000:1.0:1790391445.394973:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169601280 00000100:00100000:1.0:1790391445.394987:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169601792 00000100:00100000:1.0:1790391445.394989:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169601792 00000100:00100000:1.0:1790391445.395004:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 298 00000100:00100000:1.0:1790391445.395011:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169601408:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391445.395055:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169601408:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 43us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391445.395062:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 298 00000100:00100000:1.0:1790391445.395079:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 299 00000100:00100000:1.0:1790391445.395085:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169601920:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391445.395162:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169601920:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 76us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391445.395168:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 299 00000100:00100000:1.0:1790391445.395182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 300 00000100:00100000:1.0:1790391445.395189:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:2384:x1877361169601280:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391445.395230:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:2384:x1877361169601280:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 42us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391445.395245:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 300 00000100:00100000:1.0:1790391445.395259:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 301 00000100:00100000:1.0:1790391445.395265:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169601792:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391445.395291:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169601792:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 27us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391445.395309:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 301 00000100:00100000:1.0:1790391445.395329:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169601664 00000100:00100000:1.0:1790391445.395333:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169601664 00000100:00100000:1.0:1790391445.395356:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169601536 00000100:00100000:1.0:1790391445.395358:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169601536 00000100:00100000:1.0:1790391445.395376:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 143 00000100:00100000:1.0:1790391445.395382:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169601664:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391445.395406:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169601664:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 25us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391445.395412:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 143 00000100:00100000:1.0:1790391445.395422:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 144 00000100:00100000:1.0:1790391445.395428:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169601536:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391445.395450:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169601536:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 23us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391445.395455:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 144 00000100:00080000:0.0:1790391445.395655:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391445.395661:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391445.395663:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1790391445.450161:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790391445.512037:0:8832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358879157196ns, next at 359879154247ns, rc = 0 00000100:00100000:1.0:1790391445.512068:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186450816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391445.512144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391445.512226:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186450944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391445.512252:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391445.512289:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391445.512307:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186451072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391445.512332:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186450816 00000100:00100000:1.0:1790391445.512333:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391445.512340:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186450816 00000100:00100000:1.0:1790391445.512362:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186451072 00000100:00100000:1.0:1790391445.512365:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186451072 00000100:00100000:3.0:1790391445.512396:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186450944 00000100:00100000:3.0:1790391445.512399:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186450944 00000100:00100000:1.0:1790391445.512400:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790391445.512408:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186451072:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391445.512414:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790391445.512420:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1877361186450816:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:1.0:1790391445.512438:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:3.0:1790391445.512439:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1790391445.512479:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186451072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391445.512486:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790391445.512506:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790391445.512515:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186450944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391445.512531:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790391445.521288:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1877361186450816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8855us (9132us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391445.521317:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1790391445.521942:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391445.522779:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186451072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391445.522889:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186450816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391445.531564:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186450944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 19039us (19300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391445.531580:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790391445.534196:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186450944:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790391446.473350:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790391446.539213:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:3.0:1790391446.539805:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1790391446.539820:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:1.0:1790391446.546708:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391446.546734:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186451200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790391446.546810:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391446.547094:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186451200 00000100:00100000:2.0:1790391446.547111:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186451200 00000100:00100000:2.0:1790391446.547174:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790391446.547184:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186451200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790391446.547539:0:10505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790391446.547544:0:10505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790391440 -> 1790391440 00002000:00010000:2.0:1790391446.547546:0:10505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1790391439 -> 1790391439 00002000:00010000:2.0:1790391446.547549:0:10505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790391440 -> 1790391440 00002000:00010000:2.0:1790391446.547551:0:10505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1790391446.547652:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186451200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 469us (840us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1790391446.547661:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000001:00080000:0.0:1790391446.547798:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1790391446.547820:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e51822df900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1790391446.547825:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e52bfa24800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e51822df540 00000020:00080000:0.0:1790391446.547828:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e52bfa24500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e52a0d13400 00000020:00080000:0.0:1790391446.547847:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1790391446.547866:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391446.547904:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391446.547927:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391446.547933:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391446.547938:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391446.547946:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391446.547961:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e51821bbd00) 00010000:00010000:0.0:1790391446.547964:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391446.547969:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391446.547976:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e18c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790391446.549574:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1790391446.549672:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1790391446.550946:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1790391446.550956:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5183b08380, transno 4294967310 00000004:00080000:1.0:1790391446.550969:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1790391446.550994:0:3638:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9e518404d500 x1877361186451200/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790391462 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1790391446.551005:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e518404d500/2, rc 0, transno 4294967313 00000100:00100000:1.0:1790391446.551017:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186451200:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1790391447.507371:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391447.560219:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391447.560245:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186451328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391447.560318:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391447.562980:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186451328 00000100:00100000:3.0:1790391447.562997:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186451328 00000100:00100000:3.0:1790391447.563074:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790391447.563084:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186451328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391447.563124:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1790391447.563217:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186451328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391447.563225:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790391447.566037:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51820ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186451328:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790391448.521548:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391448.912051:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391448.912577:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169602048 00000100:00100000:0.0:1790391448.912590:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169602048 00000100:00100000:0.0:1790391448.912672:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 147 00000100:00100000:0.0:1790391448.912684:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:11067:x1877361169602048:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790391448.912814:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51820ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:11067:x1877361169602048:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 Request processed in 133us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391448.912823:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 147 00000100:00080000:3.0:1790391448.912943:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391448.916182:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391448.916474:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169602176 00000100:00100000:2.0:1790391448.916485:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169602176 00000100:00100000:2.0:1790391448.916556:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 148 00000100:00100000:2.0:1790391448.916567:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:11067:x1877361169602176:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790391448.916674:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:11067:x1877361169602176:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 Request processed in 109us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391448.916682:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 148 00000100:00080000:3.0:1790391448.917107:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391448.942482:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391448.942543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169602432 00000100:00100000:3.0:1790391448.942554:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169602432 00000100:00100000:3.0:1790391448.942654:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:3.0:1790391448.942666:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:11067:x1877361169602432:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790391448.942999:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:11067:x1877361169602432:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 333us (526us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1790391448.943007:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:2.0:1790391449.096282:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186451840:0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.096380:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391449.096437:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186452352:0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.096474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391449.096499:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186452864:0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.096522:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391449.096552:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790391449.096558:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186451712:0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.096584:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391449.096598:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186452224:0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.096619:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391449.096634:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186452736:0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.096652:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391449.096681:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186451840 00000100:00100000:2.0:1790391449.096689:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186451840 00000100:00100000:2.0:1790391449.096730:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186452224 00000100:00100000:2.0:1790391449.096745:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186452224 00000100:00100000:2.0:1790391449.096768:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186452736 00000100:00100000:2.0:1790391449.096771:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186452736 00000100:00100000:2.0:1790391449.096789:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1790391449.096797:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186451840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.096851:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186451840:12345-0@lo:400:kworker.0 Request processed in 54us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391449.096858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1790391449.096950:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1790391449.096956:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186452224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.096985:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186452224:12345-0@lo:400:kworker.0 Request processed in 29us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391449.096992:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1790391449.097002:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1790391449.097008:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186452736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.097047:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186452736:12345-0@lo:400:kworker.0 Request processed in 39us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391449.097062:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00080000:2.0:1790391449.097100:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b56d80 x1877361186452224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391449.097115:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186452224:0@lo:400:kworker.0 00010000:00080000:2.0:1790391449.097126:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b57100 x1877361186452736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391449.097134:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186452736:0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.097143:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186451840:0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097235:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186451584:0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097274:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391449.097300:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186452096:0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391449.097339:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186452608:0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097359:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391449.097371:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1790391449.097377:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186451456:0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097401:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391449.097421:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186451968:0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097443:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391449.097460:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186452480:0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097481:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391449.097501:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186452992:0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097520:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391449.097543:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186451712 00000100:00100000:3.0:1790391449.097547:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186451712 00000100:00100000:3.0:1790391449.097581:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186451968 00000100:00100000:3.0:1790391449.097585:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186451968 00000100:00100000:3.0:1790391449.097597:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790391449.097604:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186451712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097641:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186451712:12345-0@lo:400:kworker.0 Request processed in 38us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391449.097648:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790391449.097661:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790391449.097667:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186451968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097697:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186451968:12345-0@lo:400:kworker.0 Request processed in 30us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391449.097702:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790391449.097720:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186452352 00000100:00100000:3.0:1790391449.097724:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186452352 00000100:00100000:3.0:1790391449.097747:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186452864 00000100:00100000:3.0:1790391449.097750:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186452864 00000100:00100000:3.0:1790391449.097762:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186452480 00000100:00100000:3.0:1790391449.097764:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186452480 00000100:00100000:3.0:1790391449.097774:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186452992 00000100:00100000:3.0:1790391449.097776:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186452992 00000100:00100000:3.0:1790391449.097789:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790391449.097795:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186452352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097824:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186452352:12345-0@lo:400:kworker.0 Request processed in 29us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391449.097830:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790391449.097841:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790391449.097846:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186452864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097917:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186452864:12345-0@lo:400:kworker.0 Request processed in 71us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391449.097930:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790391449.097942:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790391449.097948:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186452480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.097976:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186452480:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391449.097981:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790391449.097991:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790391449.097995:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186452992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.098020:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186452992:12345-0@lo:400:kworker.0 Request processed in 24us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391449.098026:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1790391449.098041:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391449.098045:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391449.098047:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391449.098068:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186451968:0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.098077:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186452480:0@lo:400:kworker.0 00000100:00100000:3.0:1790391449.098086:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1790391449.098090:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1790391449.098108:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e518382b480, transno 4294967305 00000100:00100000:3.0:1790391449.098118:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186452992:0@lo:400:kworker.0 00000100:00100000:1.0:1790391449.098319:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186451456 00000100:00100000:1.0:1790391449.098324:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186451456 00000100:00100000:1.0:1790391449.098372:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1790391449.098380:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186451456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391449.098419:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186451456:12345-0@lo:400:kworker.0 Request processed in 41us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391449.098426:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1790391449.098551:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186451584 00000100:00100000:1.0:1790391449.098555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186451584 00000100:00100000:1.0:1790391449.098570:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186452096 00000100:00100000:1.0:1790391449.098572:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186452096 00000100:00100000:1.0:1790391449.098586:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186452608 00000100:00100000:1.0:1790391449.098588:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186452608 00000100:00100000:1.0:1790391449.098599:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1790391449.098604:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186451584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391449.098631:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186451584:12345-0@lo:400:kworker.0 Request processed in 27us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391449.098636:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1790391449.098645:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1790391449.098651:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186452096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391449.098670:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186452096:12345-0@lo:400:kworker.0 Request processed in 20us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391449.098676:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1790391449.098684:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1790391449.098696:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186452608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391449.098720:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186452608:12345-0@lo:400:kworker.0 Request processed in 25us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391449.098725:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1790391449.098750:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186451456:0@lo:400:kworker.0 00000100:00100000:1.0:1790391449.098760:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186451584:0@lo:400:kworker.0 00000100:00100000:1.0:1790391449.098769:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186452096:0@lo:400:kworker.0 00000100:00100000:1.0:1790391449.098777:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186452608:0@lo:400:kworker.0 00000100:00080000:3.0:1790391449.098975:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391449.099844:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186451712:0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.099858:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186452352:0@lo:400:kworker.0 00000100:00100000:2.0:1790391449.099970:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186452864:0@lo:400:kworker.0 00000100:00100000:0.0:1790391449.307784:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391449.307908:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169602560 00000100:00100000:1.0:1790391449.307918:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169602560 00000100:00100000:1.0:1790391449.308005:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 149 00000100:00100000:1.0:1790391449.308017:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:11881:x1877361169602560:12345-192.168.202.28@tcp:101:lsof.0 00010000:00010000:1.0:1790391449.308040:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391449.308063:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02ea expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391449.308143:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391449.308159:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391449.308174:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391449.308222:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790391449.308351:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391449.308395:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391449.308422:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ea expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391449.308441:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ea expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391449.308450:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:1.0:1790391449.308453:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391449.308457:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086000, rc 0) 00000100:00100000:1.0:1790391449.308528:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:11881:x1877361169602560:12345-192.168.202.28@tcp:101:lsof.0 Request processed in 512us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391449.308535:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 149 00000100:00080000:3.0:1790391449.308600:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790391449.548711:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391449.608146:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186453120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391449.608247:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391449.608416:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186453120 00000100:00100000:1.0:1790391449.608426:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186453120 00000100:00100000:1.0:1790391449.608492:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790391449.608502:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186453120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391449.608534:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391449.608583:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186453120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391449.608591:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790391449.609030:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186453120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391449.609320:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391449.609331:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186453248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391449.609368:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391449.609415:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186453248 00000100:00100000:3.0:1790391449.609421:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186453248 00000100:00100000:3.0:1790391449.609468:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790391449.609477:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186453248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391449.609492:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391449.609528:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186453248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391449.609535:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790391449.609564:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186453248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391450.506311:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391450.506364:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391450.506407:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391450.506437:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391450.506477:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169602944 00000100:00100000:1.0:1790391450.506481:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391450.506488:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169602944 00000100:00100000:1.0:1790391450.506499:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391450.506522:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391450.506544:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169603200 00000100:00100000:2.0:1790391450.506545:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169603456 00000100:00100000:2.0:1790391450.506548:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169603456 00000100:00100000:1.0:1790391450.506548:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169603200 00000100:00100000:2.0:1790391450.506562:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169602816 00000100:00100000:2.0:1790391450.506566:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169602816 00000100:00100000:1.0:1790391450.506574:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169603072 00000100:00100000:1.0:1790391450.506577:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169603072 00000100:00100000:2.0:1790391450.506580:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169603328 00000100:00100000:2.0:1790391450.506583:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169603328 00000100:00100000:2.0:1790391450.506602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 308 00000100:00100000:1.0:1790391450.506602:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 149 00000100:00100000:2.0:1790391450.506613:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169602944:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391450.506613:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169603200:12345-192.168.202.28@tcp:400:kworker.0 00000100:00080000:3.0:1790391450.506614:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790391450.506629:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391450.506635:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391450.506639:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391450.506676:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 150 00000100:00100000:2.0:1790391450.506693:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169602944:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 80us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391450.506702:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169603072:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391450.506715:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169602688 00000100:00100000:0.0:1790391450.506721:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169602688 00000100:00100000:2.0:1790391450.506734:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 308 00000100:00100000:2.0:1790391450.506754:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 309 00000100:00100000:0.0:1790391450.506756:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 387 00000100:00100000:2.0:1790391450.506762:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169603456:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391450.506762:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169602688:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391450.509302:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169603200:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 2524us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391450.509318:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 149 00000100:00100000:1.0:1790391450.509995:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 310 00000100:00100000:1.0:1790391450.510012:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:2383:x1877361169602816:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391450.510152:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:2383:x1877361169602816:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 147us (3668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391450.510160:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 310 00000100:00100000:3.0:1790391450.510184:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169603072:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 3483us (3669us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391450.510196:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 311 00000100:00100000:3.0:1790391450.510203:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 150 00000100:00100000:1.0:1790391450.510210:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2383:x1877361169603328:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391450.510231:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169603456:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 3468us (3791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391450.510240:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 309 00000100:00100000:1.0:1790391450.510243:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2383:x1877361169603328:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 39us (3720us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391450.510248:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 311 00000100:00100000:0.0:1790391450.514714:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169602688:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 7937us (8401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391450.514731:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 387 00010000:00010000:0.0:1790391450.568378:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391450.632454:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186453376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391450.632534:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391450.632575:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186453504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391450.632612:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391450.632627:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186453376 00000100:00100000:1.0:1790391450.632650:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186453376 00000100:00100000:2.0:1790391450.632669:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186453504 00000100:00100000:2.0:1790391450.632672:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186453504 00000100:00100000:2.0:1790391450.632701:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790391450.632701:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790391450.632709:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186453504:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391450.632709:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186453376:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:2.0:1790391450.632739:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:1.0:1790391450.632739:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790391450.632780:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186453504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391450.632780:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186453376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391450.632788:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790391450.632788:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790391450.632836:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186453376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391450.635955:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186453632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391450.637660:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186453504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391450.638181:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391450.638400:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186453632 00000100:00100000:3.0:1790391450.638412:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186453632 00000100:00100000:3.0:1790391450.638485:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790391450.638497:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186453632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391450.638552:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790391450.638626:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186453632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391450.638634:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790391450.638739:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186453632:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790391451.596536:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391452.616119:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391452.682238:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391452.682258:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186453760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391452.682318:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391452.682377:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186453760 00000100:00100000:0.0:1790391452.682383:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186453760 00000100:00100000:0.0:1790391452.682420:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790391452.682426:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186453760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790391452.682453:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1790391452.682493:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186453760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391452.682500:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790391452.682546:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186453760:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1790391452.684065:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1790391452.692006:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1790391452.692027:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1790391452.693617:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1790391452.693646:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1790391453.645509:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790391453.858608:0:14556:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:57:32 (1790391452) 00000100:00100000:2.0:1790391454.216224:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186454144:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.216504:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186453888:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.216570:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391454.216649:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186454400:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.216677:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391454.216698:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186454912:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.216762:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391454.216783:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186455424:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.216803:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391454.217539:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186454272:0@lo:400:kworker.0 00000100:00100000:1.0:1790391454.217606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391454.217642:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186454784:0@lo:400:kworker.0 00000100:00100000:2.0:1790391454.217762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391454.217791:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186454656:0@lo:400:kworker.0 00000100:00100000:2.0:1790391454.217846:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391454.217863:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186455168:0@lo:400:kworker.0 00000100:00100000:2.0:1790391454.217918:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391454.217959:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790391454.217967:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186454016:0@lo:400:kworker.0 00000100:00100000:2.0:1790391454.217993:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391454.218008:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186454528:0@lo:400:kworker.0 00000100:00100000:2.0:1790391454.218030:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391454.218040:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186455040:0@lo:400:kworker.0 00000100:00100000:2.0:1790391454.218059:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391454.218095:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186454272 00000100:00100000:2.0:1790391454.218104:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186454272 00000100:00100000:2.0:1790391454.218157:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186454656 00000100:00100000:2.0:1790391454.218160:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186454656 00000100:00100000:2.0:1790391454.218186:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186455168 00000100:00100000:2.0:1790391454.218189:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186455168 00000100:00100000:2.0:1790391454.218202:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186454016 00000100:00100000:2.0:1790391454.218204:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186454016 00000100:00100000:2.0:1790391454.218214:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186454528 00000100:00100000:2.0:1790391454.218216:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186454528 00000100:00100000:2.0:1790391454.218227:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186455040 00000100:00100000:2.0:1790391454.218230:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186455040 00000100:00100000:2.0:1790391454.218245:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1790391454.218254:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186454272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.218549:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186453888 00000100:00100000:0.0:1790391454.218555:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186453888 00000100:00100000:0.0:1790391454.218588:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1790391454.218596:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5289dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186453888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.218638:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5289dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186453888:12345-0@lo:400:kworker.0 Request processed in 42us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391454.218644:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1790391454.218686:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186454400 00000100:00100000:0.0:1790391454.218691:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186454400 00000100:00100000:0.0:1790391454.218715:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186454144 00000100:00100000:0.0:1790391454.218718:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186454144 00000100:00100000:0.0:1790391454.218729:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790391454.218734:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186454400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.218768:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186454400:12345-0@lo:400:kworker.0 Request processed in 34us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391454.218784:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790391454.218796:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790391454.218800:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186454144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.218849:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186454144:12345-0@lo:400:kworker.0 Request processed in 48us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391454.218854:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790391454.218873:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186454912 00000100:00100000:0.0:1790391454.218893:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186454912 00000100:00100000:0.0:1790391454.218924:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186455424 00000100:00100000:0.0:1790391454.218927:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186455424 00000100:00100000:0.0:1790391454.218946:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790391454.218953:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186454912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.218985:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186454912:12345-0@lo:400:kworker.0 Request processed in 34us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391454.218991:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790391454.219001:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790391454.219007:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186455424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.219029:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186455424:12345-0@lo:400:kworker.0 Request processed in 24us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391454.219034:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790391454.219084:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186453888:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.219100:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186454400:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.219111:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1790391454.219117:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e518404d500, transno 4294967313 00000100:00100000:0.0:1790391454.219131:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186454912:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.219153:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186455424:0@lo:400:kworker.0 00000100:00100000:1.0:1790391454.219543:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1790391454.219558:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186454656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391454.219607:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186454656:12345-0@lo:400:kworker.0 Request processed in 55us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391454.219613:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1790391454.219633:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1790391454.219639:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186455168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391454.219666:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186455168:12345-0@lo:400:kworker.0 Request processed in 28us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391454.219671:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1790391454.219682:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1790391454.219696:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186454016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391454.219727:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186454016:12345-0@lo:400:kworker.0 Request processed in 31us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391454.219733:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1790391454.219746:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1790391454.219753:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186454528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391454.219783:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186454528:12345-0@lo:400:kworker.0 Request processed in 31us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391454.219789:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1790391454.219801:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1790391454.219807:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186455040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391454.219847:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186455040:12345-0@lo:400:kworker.0 Request processed in 40us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391454.219853:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1790391454.220773:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186454272:12345-0@lo:400:kworker.0 Request processed in 68us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391454.220785:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00080000:2.0:1790391454.220836:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391454.220857:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391454.220862:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391454.220866:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391454.221082:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391454.221187:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186455296:0@lo:400:kworker.0 00000100:00100000:2.0:1790391454.221252:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391454.223118:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186454016:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.223142:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186454528:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.223157:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186455040:0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.223172:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186454144:0@lo:400:kworker.0 00010000:00080000:0.0:1790391454.223189:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b55880 x1877361186454656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391454.223201:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186454656:0@lo:400:kworker.0 00010000:00080000:0.0:1790391454.223215:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b56300 x1877361186455168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391454.223225:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186455168:0@lo:400:kworker.0 00000100:00100000:2.0:1790391454.225989:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186454272:0@lo:400:kworker.0 00000100:00100000:3.0:1790391454.226171:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186454784 00000100:00100000:3.0:1790391454.226182:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186454784 00000100:00080000:2.0:1790391454.226290:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391454.226547:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186455296 00000100:00100000:0.0:1790391454.226552:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186455296 00000100:00100000:0.0:1790391454.226661:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790391454.226673:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186454784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.226782:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186454784:12345-0@lo:400:kworker.0 Request processed in 111us (5700us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391454.226791:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790391454.226824:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790391454.226831:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186455296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391454.226865:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186455296:12345-0@lo:400:kworker.0 Request processed in 35us (5612us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391454.226917:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1790391454.226988:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391454.227021:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186454784:0@lo:400:kworker.0 00000100:00100000:2.0:1790391454.227035:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186455296:0@lo:400:kworker.0 00000040:00080000:0.0:1790391454.537272:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391454.537287:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391454.537427:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1790391454.537436:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790391454.664185:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391454.728931:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186455552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391454.729035:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391454.729133:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391454.729140:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186455680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391454.729167:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391454.729286:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186455552 00000100:00100000:1.0:1790391454.729297:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186455552 00000100:00100000:1.0:1790391454.729375:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186455680 00000100:00100000:1.0:1790391454.729378:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186455680 00000100:00100000:1.0:1790391454.729407:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790391454.729418:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186455552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391454.729457:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391454.729520:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186455552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391454.729528:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790391454.729546:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790391454.729552:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186455680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391454.729581:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391454.729608:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186455680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391454.729615:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790391454.730093:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186455680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391454.730113:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186455552:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1790391454.794181:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790391455.417435:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391455.417953:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169603712 00000100:00100000:1.0:1790391455.417968:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169603712 00000100:00100000:1.0:1790391455.418089:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 150 00000100:00100000:1.0:1790391455.418105:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:12149:x1877361169603712:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391455.418136:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391455.418163:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e195f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02f1 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790391455.418207:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790391455.418268:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1966 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391455.418298:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1966 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391455.418312:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1966 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391455.426783:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e196d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391455.426822:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e196d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391455.426840:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e196d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429470:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1974 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429497:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1974 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429511:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1974 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391455.429526:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790391455.429640:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1966 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429649:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1966 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429677:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1966 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429684:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391455.429689:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1966 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429711:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1966 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429725:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e52b5d77e00) 00010000:00010000:0.0:1790391455.429728:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391455.429733:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1966 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429741:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1966 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429759:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e196d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429766:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e196d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429773:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e196d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429779:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391455.429782:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e196d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429799:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e196d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429819:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e5283a48100) 00010000:00010000:0.0:1790391455.429821:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391455.429824:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e196d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.429829:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e196d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.430216:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e195f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02f1 expref: 16 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.430236:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1974 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02f1 expref: 15 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391455.430244:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:0.0:1790391455.430247:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391455.430249:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefa00, rc 0) 00000100:00100000:0.0:1790391455.430346:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:12149:x1877361169603712:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 12244us (12930us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1790391455.430355:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 150 00000100:00100000:0.0:1790391455.434507:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391455.434558:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391455.435738:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169603968 00000100:00100000:1.0:1790391455.435752:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169603968 00000100:00100000:1.0:1790391455.435843:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:1.0:1790391455.435855:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:2382:x1877361169603968:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391455.435873:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391455.435945:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1974 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02f1 expref: 15 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391455.435967:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:1.0:1790391455.435973:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391455.436045:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:2382:x1877361169603968:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 192us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391455.436054:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:2.0:1790391455.437286:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169603840 00000100:00100000:2.0:1790391455.437299:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169603840 00000100:00100000:2.0:1790391455.437371:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 151 00000100:00100000:2.0:1790391455.437382:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:12149:x1877361169603840:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790391455.437533:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:12149:x1877361169603840:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 Request processed in 153us (2974us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391455.437542:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 151 00000100:00100000:0.0:1790391455.447238:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391455.447477:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169604096 00000100:00100000:3.0:1790391455.447489:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169604096 00000100:00100000:3.0:1790391455.447578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 152 00000100:00100000:3.0:1790391455.447590:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:12149:x1877361169604096:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1790391455.447812:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391455.448117:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:12149:x1877361169604096:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 Request processed in 528us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391455.448127:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 152 00000040:00080000:1.0:1790391455.571693:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391455.571708:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391455.572296:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1790391455.572321:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790391455.628096:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391455.628206:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391455.628239:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391455.628255:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391455.628273:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391455.628321:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169604736 00000100:00100000:2.0:1790391455.628340:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169604736 00000100:00100000:2.0:1790391455.628902:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169604608 00000100:00100000:2.0:1790391455.628908:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169604608 00000100:00100000:2.0:1790391455.628963:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 318 00000100:00100000:2.0:1790391455.628985:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169604736:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391455.629093:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2381:x1877361169604736:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 110us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391455.629101:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 318 00000100:00100000:2.0:1790391455.629119:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 319 00000100:00100000:2.0:1790391455.629125:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2381:x1877361169604608:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391455.629148:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2381:x1877361169604608:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391455.629154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 319 00000100:00100000:2.0:1790391455.629175:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169604480 00000100:00100000:2.0:1790391455.629179:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169604480 00000100:00100000:2.0:1790391455.629205:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169604352 00000100:00100000:2.0:1790391455.629208:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169604352 00000100:00100000:2.0:1790391455.629226:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 155 00000100:00100000:2.0:1790391455.629233:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169604480:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391455.629257:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2381:x1877361169604480:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 25us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391455.629263:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 155 00000100:00100000:2.0:1790391455.629272:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 156 00000100:00100000:2.0:1790391455.629277:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2381:x1877361169604352:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391455.629298:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2381:x1877361169604352:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 22us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391455.629310:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 156 00000100:00080000:2.0:1790391455.629332:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391455.629337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790391455.629340:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391455.629342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391455.630448:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169604224 00000100:00100000:1.0:1790391455.630466:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169604224 00000100:00100000:1.0:1790391455.630597:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 389 00000100:00100000:1.0:1790391455.630606:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2381:x1877361169604224:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391455.630685:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2381:x1877361169604224:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 80us (2608us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391455.630693:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 389 00010000:00010000:1.0:1790391455.691125:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391455.752385:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186455808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391455.752494:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391455.752588:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186455808 00000100:00100000:1.0:1790391455.752598:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186455808 00000100:00100000:1.0:1790391455.752661:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790391455.752671:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186455808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391455.752709:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1790391455.752775:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186455808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391455.752783:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790391455.752994:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186455808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391455.755071:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186455936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391455.755159:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391455.756133:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186456064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391455.756193:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391455.756328:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186456064 00000100:00100000:0.0:1790391455.756340:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186456064 00000100:00100000:3.0:1790391455.756409:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186455936 00000100:00100000:3.0:1790391455.756415:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186455936 00000100:00100000:0.0:1790391455.756424:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790391455.756433:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b78d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186456064:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391455.756457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00002000:00000024:0.0:1790391455.756464:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790391455.756465:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186455936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391455.756507:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391455.756519:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b78d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186456064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391455.756527:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790391455.756550:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186455936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391455.756556:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790391455.756854:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186456064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391455.757145:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186455936:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1790391455.819286:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790391456.712302:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391457.736097:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391457.800167:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186456192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391457.800258:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391457.800331:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186456192 00000100:00100000:0.0:1790391457.800339:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186456192 00000100:00100000:0.0:1790391457.800384:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790391457.800392:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186456192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790391457.800426:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1790391457.800473:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186456192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391457.800481:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790391457.800525:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186456192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391457.934094:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391457.934937:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169604864 00000100:00100000:2.0:1790391457.934949:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169604864 00000100:00100000:2.0:1790391457.935022:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 153 00000100:00100000:2.0:1790391457.935038:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:12192:x1877361169604864:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391457.935061:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391457.935081:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935151:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1989 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935167:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935179:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935194:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935214:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935222:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935267:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935274:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1989 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935280:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935286:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391457.935290:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935298:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1989 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935309:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:2.0:1790391457.935312:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391457.935317:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935322:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e1989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935331:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935343:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1990 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935348:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935352:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391457.935355:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935361:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1990 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935368:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e52b9b6ca00) 00010000:00010000:2.0:1790391457.935371:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391457.935373:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1990 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935378:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1990 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935412:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1982 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02f8 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935422:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:2.0:1790391457.935424:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391457.935428:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02f8 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391457.935436:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c600, rc 0) 00000100:00100000:2.0:1790391457.935506:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:12192:x1877361169604864:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 474us (1424us total) trans 0 rc 301/301 00000100:00100000:2.0:1790391457.935514:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 153 00000100:00080000:0.0:1790391457.935950:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391457.949365:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391457.949494:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169605120 00000100:00100000:1.0:1790391457.949506:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169605120 00000100:00100000:1.0:1790391457.949571:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 154 00000100:00100000:1.0:1790391457.949582:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+14:12192:x1877361169605120:12345-192.168.202.28@tcp:36:lfs.0 00010000:00010000:1.0:1790391457.949640:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391457.949667:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e12d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b011c expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.949685:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:1.0:1790391457.949690:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391457.949751:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.949766:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ea expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.949800:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.949837:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ea expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.949850:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ea expref: 5 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391457.949865:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186456320:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391457.949984:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391457.967376:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391457.967493:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169605248 00000100:00100000:0.0:1790391457.967503:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169605248 00010000:00010000:0.0:1790391457.967568:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ea expref: 6 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391457.967608:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 79 00000100:00100000:0.0:1790391457.967628:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2384:x1877361169605248:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391457.967646:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391457.967654:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ea expref: 6 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391457.967668:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ea expref: 6 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391457.967689:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:0.0:1790391457.967695:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391457.967706:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391457.967714:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391457.967736:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391457.967804:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2384:x1877361169605248:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 177us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391457.967811:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 79 00010000:00010000:1.0:1790391457.967986:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1958 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ea expref: 5 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391457.968003:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186456320:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391457.968024:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968033:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968039:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968063:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968072:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968087:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968721:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968733:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968740:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391457.968756:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004283e497 reply state 000000007f02cceb transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968766:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968772:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:1.0:1790391457.968856:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391457.968860:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790391457.968868:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1790391457.968907:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968916:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968924:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968930:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391457.968942:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968949:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968959:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48800) 00010000:00010000:1.0:1790391457.968961:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391457.968965:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968971:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1997 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391457.968990:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004283e497 reply state 000000007f02cceb transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.968998:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391457.969004:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e5283a48200) 00010000:00010000:1.0:1790391457.969006:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391457.969008:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1790391457.969089:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:12192:x1877361169605120:12345-192.168.202.28@tcp:36:lfs.0 Request processed in 19507us (19734us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1790391457.969098:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 154 00000100:00080000:2.0:1790391457.975936:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391458.102698:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.102904:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169605376 00000100:00100000:2.0:1790391458.102915:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169605376 00000100:00100000:2.0:1790391458.103035:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 155 00000100:00100000:2.0:1790391458.103047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+15:12200:x1877361169605376:12345-192.168.202.28@tcp:101:lctl.0 00010000:00010000:2.0:1790391458.103076:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391458.103101:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e19ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b02ff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.103171:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e19b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.103183:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e19b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.103192:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e19b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391458.103238:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790391458.103242:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391458.103263:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e19b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.103283:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e19ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ff expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.103313:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e19b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ff expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.103319:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b6ca00) 00010000:00010000:2.0:1790391458.103322:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391458.103324:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d000, rc 0) 00000100:00100000:2.0:1790391458.103377:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:12200:x1877361169605376:12345-192.168.202.28@tcp:101:lctl.0 Request processed in 335us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391458.103383:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 155 00000100:00100000:2.0:1790391458.176057:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391458.176203:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169605504 00000100:00100000:0.0:1790391458.176217:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169605504 00000100:00100000:0.0:1790391458.176318:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 156 00000100:00100000:0.0:1790391458.176330:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+16:12206:x1877361169605504:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:0.0:1790391458.176371:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391458.176402:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e19ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0306 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176524:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e19c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176541:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e19c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176556:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e19c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176570:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e19c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176578:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e19c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176584:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e19c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176693:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e19cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176702:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e19cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176709:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e19cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391458.176756:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1790391458.176761:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391458.176800:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e19cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176826:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e19c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176833:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e19c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176840:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e19c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176848:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391458.176853:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e19c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176862:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e19c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176930:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b6ca00) 00010000:00010000:0.0:1790391458.176935:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391458.176941:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e19c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176949:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e19c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176966:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e19c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176972:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e19c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176979:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e19c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.176991:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391458.176995:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e19c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.177003:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e19c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.177012:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e5283a48200) 00010000:00010000:0.0:1790391458.177015:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391458.177018:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e19c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.177024:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e19c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.177057:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e19ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0306 expref: 18 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.177073:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e19cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0306 expref: 17 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.177081:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391458.177083:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790391458.177086:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee600, rc 0) 00000100:00100000:0.0:1790391458.177185:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:12206:x1877361169605504:12345-192.168.202.28@tcp:101:bash.0 Request processed in 858us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391458.177193:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 156 00000100:00100000:3.0:1790391458.181851:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391458.182032:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169605760 00000100:00100000:0.0:1790391458.182053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169605760 00000100:00100000:0.0:1790391458.182123:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 157 00000100:00100000:0.0:1790391458.182136:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:12206:x1877361169605760:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:0.0:1790391458.182165:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391458.182195:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e19d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b030d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.182369:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e19dd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.182389:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e19dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.182404:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e19dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.186385:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.186410:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.186423:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790391458.188047:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1790391458.188226:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188248:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188274:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188455:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e19dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188464:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e19dd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188471:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e19dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188476:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391458.188480:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e19dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188488:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e19dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188500:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391458.188503:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391458.188515:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e19dd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188522:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e19dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391458.188536:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f6ebb98 reply state 000000004365f384 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188547:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188559:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e5182c83500) 00010000:00010000:0.0:1790391458.188561:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790391458.188564:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790391458.188599:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e19d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b030d expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188622:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b030d expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.188630:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e5182c83f00) 00010000:00010000:0.0:1790391458.188632:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391458.188634:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefa00, rc 0) 00000100:00100000:0.0:1790391458.188862:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:12206:x1877361169605760:12345-192.168.202.28@tcp:101:bash.0 Request processed in 6728us (7025us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1790391458.188871:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 157 00000100:00100000:2.0:1790391458.194733:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391458.194928:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169605888 00000100:00100000:1.0:1790391458.194944:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169605888 00000100:00100000:1.0:1790391458.195035:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:1.0:1790391458.195047:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2382:x1877361169605888:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:1.0:1790391458.195092:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391458.195119:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000707ef1f1/0x2b1b7949f13e19f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0314 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790391458.195153:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790391458.195179:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1790391458.195184:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391458.195195:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000707ef1f1/0x2b1b7949f13e19f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0314 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.195219:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000707ef1f1/0x2b1b7949f13e19f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0314 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.195237:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087000, rc 0) 00000100:00080000:2.0:1790391458.195435:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391458.195959:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2382:x1877361169605888:12345-192.168.202.28@tcp:101:bash.0 Request processed in 910us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391458.195971:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:3.0:1790391458.200263:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.200416:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169606016 00000100:00100000:2.0:1790391458.200431:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169606016 00000100:00100000:2.0:1790391458.200524:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:2.0:1790391458.200537:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:12206:x1877361169606016:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391458.200561:0:9796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391458.200586:0:9796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b031b expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.200629:0:9796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000707ef1f1/0x2b1b7949f13e19f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0314 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.200639:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391458.200643:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391458.200668:0:9796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 7 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.200715:0:9796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000707ef1f1/0x2b1b7949f13e19f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0314 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.200731:0:9796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000707ef1f1/0x2b1b7949f13e19f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0314 expref: 7 pid: 8428 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391458.200748:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183293480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9796:1877361186456448:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391458.200938:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e967d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391458.204685:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391458.204932:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169606144 00000100:00100000:0.0:1790391458.204946:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169606144 00010000:00010000:0.0:1790391458.205005:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000707ef1f1/0x2b1b7949f13e19f9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0314 expref: 8 pid: 8428 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391458.205063:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 80 00000100:00100000:0.0:1790391458.205076:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169606144:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391458.205099:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391458.205135:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000707ef1f1/0x2b1b7949f13e19f9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0314 expref: 8 pid: 8428 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.205180:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000707ef1f1/0x2b1b7949f13e19f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0314 expref: 8 pid: 8428 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.205216:0:10388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391458.205222:0:10388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391458.205234:0:10388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 8 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.205246:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 8 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.205302:0:10388:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 8 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391458.205321:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10388:1877361186456576:192.168.202.28@tcp:105: 00000100:00100000:0.0:1790391458.205455:0:10388:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5281359e40 going to sleep for 11 seconds 00010000:00010000:2.0:1790391458.206319:0:9796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000707ef1f1/0x2b1b7949f13e19f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0314 expref: 8 pid: 8428 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391458.206343:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183293480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9796:1877361186456448:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391458.206395:0:9796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 7 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.206525:0:9796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309cc00, rc 0) 00000100:00100000:2.0:1790391458.206598:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:12206:x1877361169606016:12345-192.168.202.28@tcp:101:bash.0 Request processed in 6063us (6349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391458.206608:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:3.0:1790391458.211270:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.211807:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169606400 00000100:00100000:2.0:1790391458.211821:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169606400 00000100:00100000:2.0:1790391458.211929:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 36 00000100:00100000:2.0:1790391458.211942:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:12206:x1877361169606400:12345-192.168.202.28@tcp:35:bash.0 00000100:00100000:2.0:1790391458.212631:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:12206:x1877361169606400:12345-192.168.202.28@tcp:35:bash.0 Request processed in 686us (1382us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1790391458.212642:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 36 00000100:00100000:0.0:1790391458.219089:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10388:1877361186456576:192.168.202.28@tcp:105: 00010000:00010000:0.0:1790391458.219129:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391458.219221:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169606144:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 14146us (14552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391458.219236:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 80 00000100:00100000:3.0:1790391458.330632:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391458.331233:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169606656 00000100:00100000:0.0:1790391458.331665:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169606656 00000100:00100000:1.0:1790391458.332142:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 158 00000100:00100000:1.0:1790391458.332159:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:12216:x1877361169606656:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391458.332196:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391458.332225:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1a07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0322 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391458.332386:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1790391458.332522:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1a07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0322 expref: 23 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.332561:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b6ca00) 00010000:00010000:1.0:1790391458.332564:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391458.332571:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1a07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0322 expref: 23 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.332586:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086000, rc 0) 00000100:00100000:1.0:1790391458.332672:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:12216:x1877361169606656:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 519us (2057us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1790391458.332680:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 158 00000100:00100000:3.0:1790391458.336493:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391458.336683:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169606912 00000100:00100000:0.0:1790391458.336716:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169606912 00000100:00100000:0.0:1790391458.336798:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 37 00000100:00100000:0.0:1790391458.336810:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:12216:x1877361169606912:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:0.0:1790391458.337147:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:12216:x1877361169606912:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 339us (669us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1790391458.337156:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 37 00000100:00100000:3.0:1790391458.435484:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.435660:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169607040 00000100:00100000:2.0:1790391458.435674:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169607040 00000100:00100000:2.0:1790391458.435807:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 159 00000100:00100000:2.0:1790391458.435821:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:12222:x1877361169607040:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391458.435856:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391458.435934:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0329 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.436035:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1a1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.436053:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.436067:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391458.436126:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790391458.436131:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391458.436155:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.436190:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0329 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.436214:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1a1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0329 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.436246:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391458.436250:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391458.436254:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309de00, rc 0) 00000100:00100000:2.0:1790391458.436342:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:12222:x1877361169607040:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 525us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391458.437273:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 159 00000100:00100000:3.0:1790391458.440992:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.441405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169607296 00000100:00100000:2.0:1790391458.441419:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169607296 00000100:00100000:2.0:1790391458.441515:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 160 00000100:00100000:2.0:1790391458.441529:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:12222:x1877361169607296:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391458.441563:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391458.441594:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0330 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.441768:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1a2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.441795:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1a2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.441810:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1a2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391458.441824:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790391458.441995:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0330 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.442044:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1a2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0330 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.442056:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e5182c83f00) 00010000:00010000:2.0:1790391458.442059:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391458.442064:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d800, rc 0) 00000100:00100000:2.0:1790391458.442145:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+26:12222:x1877361169607296:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 618us (1169us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1790391458.442154:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 160 00000100:00100000:3.0:1790391458.448788:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391458.449001:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169607552 00000100:00100000:0.0:1790391458.449018:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169607552 00000100:00100000:0.0:1790391458.449108:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 161 00000100:00100000:0.0:1790391458.449120:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+26:12222:x1877361169607552:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391458.449155:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391458.449183:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0337 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.449580:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1a3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.449601:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1a3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.449615:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1a3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391458.449630:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790391458.449784:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0337 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.449810:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1a3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0337 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.449843:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e5182c83f00) 00010000:00010000:0.0:1790391458.449846:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790391458.449851:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefe00, rc 0) 00000100:00100000:0.0:1790391458.450307:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:12222:x1877361169607552:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 1175us (1529us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1790391458.450317:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 161 00000100:00100000:3.0:1790391458.456618:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391458.456726:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169607680 00000100:00100000:0.0:1790391458.456739:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169607680 00000100:00100000:0.0:1790391458.456847:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:0.0:1790391458.456860:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:2384:x1877361169607680:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391458.456910:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391458.456947:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1a2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0330 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.456973:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e5182c83f00) 00010000:00010000:0.0:1790391458.456980:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391458.457059:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:2384:x1877361169607680:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 201us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391458.457067:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:3.0:1790391458.468100:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391458.468247:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169607808 00000100:00100000:1.0:1790391458.468270:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169607808 00000100:00100000:1.0:1790391458.468346:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:1.0:1790391458.468364:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169607808:12345-192.168.202.28@tcp:1:lfs.0 00010000:00010000:1.0:1790391458.468442:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.468469:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 6 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.468480:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391458.468486:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391458.468493:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.468550:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 6 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.468591:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 6 pid: 9796 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391458.468614:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518404fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1877361186456704:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391458.469306:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685840 going to sleep for 11 seconds 00000100:00100000:3.0:1790391458.473126:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391458.473257:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169607936 00000100:00100000:0.0:1790391458.473271:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169607936 00002000:00100000:0.0:1790391458.473350:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9e5183b7f800 x1877361169607936/t0(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:324/0 lens 504/0 e 0 to 0 dl 1790391469 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391458.473377:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5183b7f800 with x1877361169607936 ext(0->12) 00010000:00010000:0.0:1790391458.473392:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 7 pid: 9796 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.473438:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 7 pid: 9796 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391458.473448:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5183b7f800 00000100:00100000:0.0:1790391458.473501:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:0.0:1790391458.473514:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169607936:12345-192.168.202.28@tcp:4:lfs.0 00000100:00100000:1.0:1790391458.474706:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518404fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1877361186456704:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391458.474742:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391458.475102:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2383:x1877361169607936:12345-192.168.202.28@tcp:4:lfs.0 Request processed in 1588us (1988us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790391458.475113:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 2 00002000:00100000:0.0:1790391458.475126:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9e5183b7f800 x1877361169607936/t4294967306(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:324/0 lens 504/448 e 0 to 0 dl 1790391469 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391458.475136:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5183b7f800 with x1877361169607936 ext(0->12) 00010000:00010000:0.0:1790391458.475146:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 9 pid: 9796 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.475162:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 9 pid: 9796 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391458.475170:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5183b7f800 00000100:00100000:3.0:1790391458.479002:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391458.479139:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169608064 00000100:00100000:1.0:1790391458.479154:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169608064 00010000:00010000:1.0:1790391458.479216:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 9 pid: 9796 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391458.479278:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 81 00000100:00100000:1.0:1790391458.479291:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2381:x1877361169608064:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391458.479322:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790391458.479348:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790391458.479360:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790391458 00002000:00010000:1.0:1790391458.479363:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790391459 00002000:00010000:1.0:1790391458.479366:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1790391458 00002000:00010000:1.0:1790391458.479368:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1790391458.479377:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 9 pid: 9796 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.479419:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 9 pid: 9796 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.479451:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000797fd3e/0x2b1b7949f13e1a00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b031b expref: 9 pid: 9796 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.479476:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391458.479482:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391458.479490:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.479503:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.479551:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391458.479632:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2381:x1877361169608064:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 342us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391458.479641:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 81 00010000:00010000:3.0:1790391458.480364:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.480381:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.480414:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.480424:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.480434:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.480459:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391458.480464:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.480476:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.480493:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.480502:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e215bc/0x2b1b7949f13e1a4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391458.480590:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169607808:12345-192.168.202.28@tcp:1:lfs.0 Request processed in 12232us (12506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391458.480600:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:3.0:1790391458.484097:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391458.484469:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169608320 00000100:00100000:0.0:1790391458.484484:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169608320 00000100:00100000:0.0:1790391458.484557:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 38 00000100:00100000:0.0:1790391458.484569:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12222:x1877361169608320:12345-192.168.202.28@tcp:35:lfs.0 00000004:00010000:0.0:1790391458.484669:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1a3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0337 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391458.484966:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1790391458.485001:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1790391458.485840:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1790391458.485983:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.486004:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b030d expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.486014:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.486062:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b030d expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.486081:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b030d expref: 31 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391458.486098:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1877361186456832:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391458.486305:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183898000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391458.495172:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391458.495265:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169608448 00000100:00100000:3.0:1790391458.495278:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169608448 00010000:00010000:3.0:1790391458.495339:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b030d expref: 32 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391458.495394:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 82 00000100:00100000:3.0:1790391458.495406:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:2384:x1877361169608448:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391458.495426:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391458.495455:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b030d expref: 32 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.495474:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b030d expref: 32 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.495503:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e5182c83f00) 00010000:00010000:3.0:1790391458.495509:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.495522:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.495531:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.495557:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391458.495630:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:2384:x1877361169608448:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 224us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391458.495639:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 82 00010000:00010000:0.0:1790391458.497176:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e19eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b030d expref: 31 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391458.497205:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1877361186456832:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391458.497237:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.497279:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391458.497285:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391458.497624:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1790391458.497793:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1790391458.498282:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877361186456960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790391458.498584:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391458.498698:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183898540 going to sleep for 11 seconds 00000100:00100000:2.0:1790391458.500162:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186456960 00000100:00100000:2.0:1790391458.500181:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186456960 00000100:00100000:2.0:1790391458.500402:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790391458.500423:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1877361186456960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790391458.500606:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1877361186456960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 187us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391458.500615:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790391458.500766:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877361186456960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790391458.501022:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1790391458.501124:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877361186457088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790391458.501182:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391458.501219:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290268f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391458.501685:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186457088 00000100:00100000:2.0:1790391458.501695:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186457088 00000100:00100000:2.0:1790391458.501798:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790391458.501809:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1877361186457088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790391458.502015:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6516:x1877361186457088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 206us (831us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790391458.502023:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790391458.502107:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1877361186457088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790391458.502175:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1790391458.502221:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.502509:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.502520:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.502527:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391458.502533:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.502544:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.502566:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e5182c83f00) 00010000:00010000:3.0:1790391458.502569:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790391458.502576:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.502582:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1a54 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391458.502710:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790391458.502801:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1790391458.502815:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371869936677ns, next at 372869933915ns, rc = 0 00000001:00080000:3.0:1790391458.502822:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1790391458.502849:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e5182c83f00) 00010000:00010000:3.0:1790391458.502852:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790391458.502861:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1a3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0337 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391458.503055:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:12222:x1877361169608320:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 18488us (18976us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1790391458.503065:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 38 00000020:00080000:3.0:1790391458.503071:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1790391458.503927:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391458.507080:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.507618:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169608576 00000100:00100000:2.0:1790391458.507653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169608576 00000100:00100000:2.0:1790391458.507732:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 162 00000100:00100000:2.0:1790391458.507745:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:12222:x1877361169608576:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391458.507788:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391458.507821:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1a5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b033e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.507918:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1a5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b033e expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.507937:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1a5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b033e expref: 35 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.507961:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391458.507965:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391458.507970:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c200, rc 0) 00000100:00100000:2.0:1790391458.510195:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12222:x1877361169608576:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 2435us (3115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391458.510212:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 162 00000100:00100000:3.0:1790391458.514131:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.514242:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169608832 00000100:00100000:2.0:1790391458.514465:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169608832 00000100:00100000:2.0:1790391458.514551:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:2.0:1790391458.514563:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12222:x1877361169608832:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:2.0:1790391458.514946:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:12222:x1877361169608832:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 383us (831us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1790391458.514954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:0.0:1790391458.616565:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.616695:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169609088 00000100:00100000:2.0:1790391458.616737:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169609088 00000100:00100000:2.0:1790391458.616831:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 163 00000100:00100000:2.0:1790391458.616846:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:12232:x1877361169609088:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391458.616923:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391458.616959:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0345 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391458.617103:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790391458.617247:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0345 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.617266:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b6ca00) 00010000:00010000:2.0:1790391458.617270:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391458.617277:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0345 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.617311:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c600, rc 0) 00000100:00100000:2.0:1790391458.617751:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:12232:x1877361169609088:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 906us (1198us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1790391458.617761:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 163 00000100:00100000:3.0:1790391458.623657:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.623744:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169609216 00000100:00100000:2.0:1790391458.623757:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169609216 00000100:00100000:2.0:1790391458.623856:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 164 00000100:00100000:2.0:1790391458.623870:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:12232:x1877361169609216:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:2.0:1790391458.624020:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a70 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624042:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624077:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624091:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624098:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624105:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624221:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624230:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624238:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391458.624319:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624335:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624343:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a70 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624752:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624785:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309cc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391458.624790:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624799:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a70 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624816:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391458.624819:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391458.624825:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624833:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624852:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624858:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624865:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624870:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391458.624873:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624908:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624927:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e5182c83500) 00010000:00010000:2.0:1790391458.624930:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391458.624934:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624939:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624950:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624956:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624961:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624966:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ce00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391458.624969:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624975:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624982:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391458.624984:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391458.624988:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.624994:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391458.625259:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:12232:x1877361169609216:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 1380us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391458.625270:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 164 00000100:00100000:3.0:1790391458.630425:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.630659:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169609472 00000100:00100000:2.0:1790391458.630676:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169609472 00000100:00100000:2.0:1790391458.630820:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:2.0:1790391458.630834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:12232:x1877361169609472:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:2.0:1790391458.631152:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:12232:x1877361169609472:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 320us (741us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1790391458.631161:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:1.0:1790391458.685321:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.685465:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169609728 00000100:00100000:2.0:1790391458.685479:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169609728 00000100:00100000:2.0:1790391458.685566:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 165 00000100:00100000:2.0:1790391458.685579:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:12235:x1877361169609728:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391458.685610:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391458.685640:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b034c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.685742:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.685761:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.685788:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.685826:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.685834:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.685841:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686055:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686064:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686073:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391458.686086:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790391458.686202:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686210:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a8c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686219:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686225:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391458.686230:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686250:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686265:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391458.686268:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391458.686274:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686282:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1a8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686299:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686305:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686311:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686316:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309cc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391458.686318:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686325:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686332:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e5182c83500) 00010000:00010000:2.0:1790391458.686334:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391458.686337:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686484:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1a93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686537:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1a85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b034c expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686552:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b034c expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.686560:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391458.686562:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391458.686565:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c600, rc 0) 00000100:00100000:2.0:1790391458.687552:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:12235:x1877361169609728:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 1965us (2251us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1790391458.687565:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 165 00000100:00100000:1.0:1790391458.696581:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391458.696684:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169609856 00000100:00100000:3.0:1790391458.696698:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169609856 00000100:00100000:3.0:1790391458.696784:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 166 00000100:00100000:3.0:1790391458.696796:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:12235:x1877361169609856:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:3.0:1790391458.696911:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1aa8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.696935:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.696950:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.697001:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.697009:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1aa8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.697016:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.697042:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391458.697048:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.697058:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.697073:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:3.0:1790391458.697076:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391458.697082:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1aa8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391458.697089:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1aa8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391458.697179:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:12235:x1877361169609856:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 385us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391458.697187:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 166 00000100:00100000:3.0:1790391458.699769:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391458.700111:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169610112 00000100:00100000:0.0:1790391458.700125:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169610112 00000100:00100000:0.0:1790391458.700228:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 41 00000100:00100000:0.0:1790391458.700240:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:12235:x1877361169610112:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:0.0:1790391458.700934:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+41:12235:x1877361169610112:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 691us (1175us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1790391458.700946:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 41 00010000:00010000:0.0:1790391458.761726:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391458.966202:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.966348:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169610368 00000100:00100000:2.0:1790391458.966372:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169610368 00000100:00100000:2.0:1790391458.966461:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 167 00000100:00100000:2.0:1790391458.966474:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+41:12266:x1877361169610368:12345-192.168.202.28@tcp:101:cat.0 00010000:00010000:2.0:1790391458.966506:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391458.966536:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1aaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0353 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.966704:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1ab6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.966722:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.966744:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391458.966759:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790391458.966955:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1aaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0353 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.966977:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0353 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391458.966986:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391458.966989:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391458.966993:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309cc00, rc 0) 00000100:00100000:2.0:1790391458.967075:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+43:12266:x1877361169610368:12345-192.168.202.28@tcp:101:cat.0 Request processed in 604us (888us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1790391458.967083:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 167 00000100:00100000:1.0:1790391458.972191:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391458.972286:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169610624 00000100:00100000:2.0:1790391458.972309:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169610624 00000100:00100000:2.0:1790391458.972403:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 42 00000100:00100000:2.0:1790391458.972416:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+43:12266:x1877361169610624:12345-192.168.202.28@tcp:35:cat.0 00000100:00100000:2.0:1790391458.972782:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+44:12266:x1877361169610624:12345-192.168.202.28@tcp:35:cat.0 Request processed in 367us (604us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1790391458.972791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 42 00000100:00100000:3.0:1790391458.975436:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391458.975606:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169610752 00000100:00100000:1.0:1790391458.975618:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169610752 00000100:00100000:1.0:1790391458.975702:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:1.0:1790391458.975714:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+44:2382:x1877361169610752:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391458.975755:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391458.975797:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1ab6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0353 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391458.975820:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391458.975826:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391458.975973:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+43:2382:x1877361169610752:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 262us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391458.975981:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:3.0:1790391459.055009:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391459.055135:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169611008 00000100:00100000:0.0:1790391459.055149:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169611008 00000100:00100000:0.0:1790391459.055245:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 168 00000100:00100000:0.0:1790391459.055258:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+43:12272:x1877361169611008:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:0.0:1790391459.055302:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391459.055324:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790391459.055369:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1a1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0329 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.055394:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391459.055400:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391459.055419:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1ac4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b035a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.055558:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.055576:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b034c expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.055586:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.055629:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b034c expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.055646:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b034c expref: 43 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391459.055662:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186457216:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391459.055797:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52851c1f00 going to sleep for 11 seconds 00000100:00080000:2.0:1790391459.056061:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391459.073110:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391459.073382:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169611136 00000100:00100000:3.0:1790391459.073397:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169611136 00010000:00010000:3.0:1790391459.073460:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b034c expref: 44 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391459.073513:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 83 00000100:00100000:3.0:1790391459.073524:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+44:2384:x1877361169611136:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391459.073568:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391459.073577:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b034c expref: 44 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.073594:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b034c expref: 44 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.074486:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:3.0:1790391459.074495:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.074508:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.074518:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.074551:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391459.074648:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+44:2384:x1877361169611136:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 1123us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391459.074658:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 83 00010000:00010000:0.0:1790391459.076317:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1a9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b034c expref: 43 pid: 6514 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391459.076381:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186457216:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391459.076412:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.076423:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.076428:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391459.076463:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790391459.076653:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1ac4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b035a expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.076670:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b035a expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.076679:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:0.0:1790391459.076683:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790391459.076686:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee200, rc 0) 00000100:00100000:0.0:1790391459.076791:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+43:12272:x1877361169611008:12345-192.168.202.28@tcp:101:dd.0 Request processed in 21535us (21807us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1790391459.076800:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 168 00000100:00100000:2.0:1790391459.083179:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391459.084264:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169611264 00000100:00100000:0.0:1790391459.084281:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169611264 00000100:00100000:0.0:1790391459.084385:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 169 00000100:00100000:0.0:1790391459.084398:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+43:12272:x1877361169611264:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:0.0:1790391459.084756:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391459.084798:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1ad9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0361 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.084850:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.084870:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.084907:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.085070:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1ad9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0361 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.085094:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0361 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391459.085104:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:0.0:1790391459.085107:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790391459.085113:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eeee00, rc 0) 00000100:00100000:0.0:1790391459.085199:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+44:12272:x1877361169611264:12345-192.168.202.28@tcp:101:dd.0 Request processed in 802us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391459.085208:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 169 00000100:00100000:2.0:1790391459.090872:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391459.095158:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169611520 00000100:00100000:1.0:1790391459.095188:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169611520 00000100:00100000:1.0:1790391459.095315:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 170 00000100:00100000:1.0:1790391459.095328:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+44:12272:x1877361169611520:12345-192.168.202.28@tcp:36:dd.0 00010000:00010000:1.0:1790391459.095675:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.095698:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.095726:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391459.095794:0:10091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1790391459.095822:0:10091:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c04dfe19 reply state 000000008ed77e38 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.095837:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.095872:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391459.095948:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391459.095954:0:10091:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391459.096093:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+47:12272:x1877361169611520:12345-192.168.202.28@tcp:36:dd.0 Request processed in 764us (5235us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1790391459.096101:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 170 00000020:00080000:1.0:1790391459.096108:0:10091:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790391459.337593:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186457600:0@lo:400:kworker.0 00000100:00100000:0.0:1790391459.337698:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391459.337800:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186457472:0@lo:400:kworker.0 00000100:00100000:0.0:1790391459.337805:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186458112:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.338040:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186457344:0@lo:400:kworker.0 00000001:00080000:3.0:1790391459.339137:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000004:00080000:3.0:1790391459.339182:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1790391459.339208:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e5290268a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1790391459.339214:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5284e83400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e5290268000 00000020:00080000:3.0:1790391459.339217:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5284e83900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e51832b6000 00010000:00010000:3.0:1790391459.339282:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.339316:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.339326:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.339333:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391459.339339:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340471:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340496:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e5283a48200) 00010000:00010000:3.0:1790391459.340499:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391459.340506:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340514:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086400/0x2b1b7949f13e199e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340543:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340549:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340556:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340561:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391459.340580:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340588:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340596:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:3.0:1790391459.340599:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391459.340602:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340609:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e19a5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340630:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340636:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340643:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340649:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391459.340652:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340658:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340666:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e5182c83500) 00010000:00010000:3.0:1790391459.340668:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391459.340680:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340685:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e19e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340705:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340712:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340718:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340723:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391459.340726:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340732:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340740:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:3.0:1790391459.340743:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391459.340746:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391459.340751:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ae7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790391459.340790:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1790391459.340926:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1790391459.341076:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186457600 00000100:00100000:3.0:1790391459.341091:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186457600 00000100:00100000:3.0:1790391459.341158:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1790391459.341170:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186457600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391459.342417:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391459.342588:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186458624:0@lo:400:kworker.0 00000100:00100000:0.0:1790391459.342646:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391459.342681:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790391459.342689:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186457728:0@lo:400:kworker.0 00000100:00100000:0.0:1790391459.342863:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391459.342917:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186458240:0@lo:400:kworker.0 00000100:00100000:0.0:1790391459.342952:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391459.342979:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186458752:0@lo:400:kworker.0 00000100:00100000:0.0:1790391459.343122:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391459.343172:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186458240 00000100:00100000:0.0:1790391459.343181:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186458240 00000100:00100000:0.0:1790391459.343249:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186458752 00000100:00100000:0.0:1790391459.343253:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186458752 00000100:00100000:0.0:1790391459.343281:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790391459.343291:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186458240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391459.343358:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186458240:12345-0@lo:400:kworker.0 Request processed in 66us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391459.343366:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790391459.343385:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790391459.343391:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186458752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391459.346149:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391459.346200:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186458752:12345-0@lo:400:kworker.0 Request processed in 2804us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391459.346218:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1790391459.346283:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391459.346290:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391459.346387:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186458240:0@lo:400:kworker.0 00000100:00100000:0.0:1790391459.346461:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186458752:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.346616:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.346657:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186457344 00000100:00100000:1.0:1790391459.346665:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186457344 00000100:00100000:1.0:1790391459.346725:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1790391459.346737:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186457344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391459.346792:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186457984:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.346805:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186457344:12345-0@lo:400:kworker.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.346813:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1790391459.346842:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.346936:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186457344:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.346947:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186457856:0@lo:400:kworker.0 00000100:00100000:2.0:1790391459.346950:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186458496:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.346989:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391459.346990:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.347021:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186458368:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.347049:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391459.347066:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186459008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790391459.347071:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186458880:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.347101:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.347137:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186458368 00000100:00100000:1.0:1790391459.347141:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186458368 00000100:00100000:1.0:1790391459.347189:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186458880 00000100:00100000:1.0:1790391459.347193:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186458880 00000100:00100000:1.0:1790391459.347212:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790391459.347218:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186458368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.347259:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186458368:12345-0@lo:400:kworker.0 Request processed in 41us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.347266:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790391459.347277:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790391459.347283:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186458880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.347310:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186458880:12345-0@lo:400:kworker.0 Request processed in 27us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.347316:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790391459.347346:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.347346:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186458368:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.347361:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186458880:0@lo:400:kworker.0 00000100:00100000:2.0:1790391459.347458:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186457856 00000100:00100000:2.0:1790391459.347464:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186457856 00000100:00100000:2.0:1790391459.347503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790391459.347510:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186457856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391459.347732:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186457856:12345-0@lo:400:kworker.0 Request processed in 221us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391459.347740:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790391459.348089:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186459008 00000100:00100000:1.0:1790391459.348095:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186459008 00000100:00100000:1.0:1790391459.348131:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790391459.348140:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1877361186459008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790391459.348169:0:10505:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1790391459.348215:0:10505:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6ab734a2, atime: 0x6ab734a3, ctime: 0x6ab734a2, blocks: 0x8 00010000:00010000:1.0:1790391459.348225:0:10505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002db5180e/0x2b1b7949f13e1aee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.348247:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1790391459.348253:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391459.348262:0:10505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db5180e/0x2b1b7949f13e1aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.348290:0:10505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db5180e/0x2b1b7949f13e1aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.348299:0:10505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002db5180e/0x2b1b7949f13e1aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.348304:0:10505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002db5180e/0x2b1b7949f13e1aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.348322:0:10505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391459.348350:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391459.348435:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002db5180e/0x2b1b7949f13e1aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.348447:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391459.348452:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002db5180e/0x2b1b7949f13e1aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.348464:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002db5180e/0x2b1b7949f13e1aee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.348500:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002db5180e/0x2b1b7949f13e1aee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.348509:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db5180e/0x2b1b7949f13e1aee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391459.348622:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186457600:12345-0@lo:400:kworker.0 Request processed in 7452us (10921us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391459.348630:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00010000:00010000:2.0:1790391459.348712:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391459.348716:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391459.348717:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391459.348905:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186459008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 766us (1560us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790391459.348909:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790391459.348929:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186458112 00000100:00100000:1.0:1790391459.348933:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186458112 00000100:00100000:1.0:1790391459.348954:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186458624 00000100:00100000:1.0:1790391459.348956:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186458624 00000100:00100000:1.0:1790391459.348964:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186457728 00000100:00100000:1.0:1790391459.348966:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186457728 00000100:00100000:1.0:1790391459.348973:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186457472 00000100:00100000:1.0:1790391459.348975:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186457472 00000100:00100000:1.0:1790391459.348983:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186457984 00000100:00100000:1.0:1790391459.348985:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186457984 00000100:00100000:1.0:1790391459.348993:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186458496 00000100:00100000:1.0:1790391459.348995:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186458496 00000100:00100000:1.0:1790391459.349009:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1790391459.349016:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186458112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.349065:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186458112:12345-0@lo:400:kworker.0 Request processed in 50us (6667us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.349069:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1790391459.349079:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1790391459.349083:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186458624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.349101:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186458624:12345-0@lo:400:kworker.0 Request processed in 18us (6456us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.349104:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1790391459.349110:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1790391459.349113:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186457728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.349129:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186457728:12345-0@lo:400:kworker.0 Request processed in 16us (6268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.349133:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1790391459.349138:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1790391459.349141:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186457472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.349155:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186457472:12345-0@lo:400:kworker.0 Request processed in 14us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.349159:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1790391459.349164:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1790391459.349167:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186457984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.349182:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186457984:12345-0@lo:400:kworker.0 Request processed in 15us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.349185:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1790391459.349191:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1790391459.349194:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186458496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.349217:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186458496:12345-0@lo:400:kworker.0 Request processed in 23us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.349221:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1790391459.349253:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186457856:0@lo:400:kworker.0 00000100:00080000:1.0:1790391459.349302:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391459.349305:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391459.349307:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391459.349330:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186457728:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.349339:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186457600:0@lo:400:kworker.0 00010000:00080000:1.0:1790391459.349591:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838f4000 x1877361186458112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391459.349601:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186458112:0@lo:400:kworker.0 00010000:00080000:1.0:1790391459.349610:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229d500 x1877361186458624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391459.349615:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186458624:0@lo:400:kworker.0 00000004:00080000:2.0:1790391459.351506:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e51830a7b80/2, rc 0, transno 4294967308 00000100:00100000:2.0:1790391459.351527:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51830a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186459008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790391459.351545:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186457472:0@lo:400:kworker.0 00000100:00100000:2.0:1790391459.351560:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186457984:0@lo:400:kworker.0 00000100:00100000:2.0:1790391459.351574:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186458496:0@lo:400:kworker.0 00000100:00100000:1.0:1790391459.489466:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391459.489637:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169611648 00000100:00100000:2.0:1790391459.489650:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169611648 00000100:00100000:2.0:1790391459.489752:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 171 00000100:00100000:2.0:1790391459.489775:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+17:12286:x1877361169611648:12345-192.168.202.28@tcp:101:stat.0 00010000:00010000:2.0:1790391459.489810:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391459.489842:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1af5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0368 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.489982:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1afc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.490019:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1afc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.490034:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1afc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.490052:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.490060:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.490068:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.490160:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.490172:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b035a expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.490182:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.490228:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b035a expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.490246:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b035a expref: 18 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391459.490276:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186459136:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391459.490427:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0bcc180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391459.500965:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186459136:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391459.501020:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391459.501581:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391459.502179:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169611904 00000100:00100000:2.0:1790391459.502191:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169611904 00000100:00100000:2.0:1790391459.502300:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 43 00000100:00100000:2.0:1790391459.502310:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:6156:x1877361169611904:12345-192.168.202.28@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790391459.502720:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:6156:x1877361169611904:12345-192.168.202.28@tcp:35:ldlm_bl.0 Request processed in 410us (1141us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1790391459.502727:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 43 00000100:00100000:2.0:1790391459.511230:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391459.511369:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169612032 00000100:00100000:1.0:1790391459.511385:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169612032 00010000:00010000:1.0:1790391459.511689:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b035a expref: 20 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391459.511780:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 84 00000100:00100000:1.0:1790391459.511795:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:2384:x1877361169612032:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391459.511816:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391459.511825:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b035a expref: 20 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.511840:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b035a expref: 20 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.511869:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1acb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b035a expref: 20 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.511930:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391459.511937:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.511950:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.511960:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.512806:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391459.512961:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:2384:x1877361169612032:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 1163us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.512973:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 84 00010000:00010000:2.0:1790391459.519209:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.519233:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391459.521184:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790391459.521195:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391459.521242:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521265:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521275:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1afc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521282:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1afc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521304:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1afc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521310:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391459.521315:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1afc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521324:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1afc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521341:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391459.521344:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391459.521349:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1afc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521355:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1afc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521374:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521380:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521385:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521389:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391459.521392:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521406:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521414:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6cb00) 00010000:00010000:2.0:1790391459.521416:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391459.521419:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521424:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521493:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1af5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0368 expref: 19 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521509:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0368 expref: 18 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.521517:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391459.521520:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391459.521522:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309de00, rc 0) 00000100:00100000:2.0:1790391459.521601:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:12286:x1877361169611648:12345-192.168.202.28@tcp:101:stat.0 Request processed in 31838us (32151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391459.521610:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 171 00000100:00100000:3.0:1790391459.596790:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391459.597468:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169612288 00000100:00100000:1.0:1790391459.597500:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169612288 00000100:00100000:1.0:1790391459.597569:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 172 00000100:00100000:1.0:1790391459.597578:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51830a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:12292:x1877361169612288:12345-192.168.202.28@tcp:36:truncate.0 00010000:00010000:1.0:1790391459.597643:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391459.597673:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1b0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0368 expref: 18 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.597693:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391459.597698:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391459.599924:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.599952:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.599965:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391459.600060:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1790391459.600095:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058eea2f2 reply state 000000008b1835d7 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.600106:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.600112:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391459.600114:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391459.600120:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391459.600261:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51830a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:12292:x1877361169612288:12345-192.168.202.28@tcp:36:truncate.0 Request processed in 2679us (3494us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1790391459.600269:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 172 00000020:00080000:1.0:1790391459.600291:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790391459.785133:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391459.809845:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391459.810222:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169612416 00000100:00100000:1.0:1790391459.810235:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169612416 00000100:00100000:1.0:1790391459.810333:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 173 00000100:00100000:1.0:1790391459.810466:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:12306:x1877361169612416:12345-192.168.202.28@tcp:101:stat.0 00010000:00010000:1.0:1790391459.810500:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391459.810529:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b036f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810617:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b1f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810634:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810648:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810666:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810673:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810679:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810785:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810796:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810827:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391459.810926:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1790391459.810931:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391459.810962:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810977:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810986:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.810993:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b1f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811000:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811006:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391459.811011:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811019:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b1f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811032:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:1.0:1790391459.811035:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391459.811041:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811060:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811077:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811083:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811089:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811094:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391459.811098:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811104:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811112:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e5283a48300) 00010000:00010000:1.0:1790391459.811114:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391459.811117:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811124:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811159:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b036f expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811170:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b036f expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391459.811181:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391459.811182:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391459.811184:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087000, rc 0) 00000100:00100000:1.0:1790391459.811260:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:12306:x1877361169612416:12345-192.168.202.28@tcp:101:stat.0 Request processed in 918us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.811272:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 173 00000100:00100000:2.0:1790391459.849903:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391459.849940:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186459264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391459.850072:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391459.850559:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186459392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391459.850655:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391459.850926:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186459264 00000100:00100000:3.0:1790391459.850932:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186459392 00000100:00100000:1.0:1790391459.850941:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186459264 00000100:00100000:3.0:1790391459.850953:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186459392 00000100:00100000:1.0:1790391459.851133:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790391459.851148:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186459264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391459.851197:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1790391459.851291:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186459264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.851300:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790391459.851321:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790391459.851328:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186459392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391459.851339:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1790391459.851366:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186459392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391459.851372:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790391459.851538:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186459392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391459.851562:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186459264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391459.923351:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391459.924693:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169612672 00000100:00100000:2.0:1790391459.924867:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169612672 00000100:00100000:2.0:1790391459.925124:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 174 00000100:00100000:2.0:1790391459.925139:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:12316:x1877361169612672:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391459.925167:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391459.925197:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1b34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0376 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391459.925343:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790391459.925491:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1b34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0376 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.925510:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b6ca00) 00010000:00010000:2.0:1790391459.925513:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391459.925520:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1b34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0376 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391459.925538:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d800, rc 0) 00000100:00100000:2.0:1790391459.925631:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:12316:x1877361169612672:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 495us (2294us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1790391459.925639:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 174 00000100:00100000:3.0:1790391459.930709:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391459.930840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169612928 00000100:00100000:0.0:1790391459.930856:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169612928 00000100:00100000:0.0:1790391459.930959:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:0.0:1790391459.930971:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:12316:x1877361169612928:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:0.0:1790391459.931306:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:12316:x1877361169612928:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 336us (614us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1790391459.931316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:3.0:1790391460.013284:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.013527:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169613184 00000100:00100000:2.0:1790391460.013541:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169613184 00000100:00100000:2.0:1790391460.013668:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 175 00000100:00100000:2.0:1790391460.013681:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:12322:x1877361169613184:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391460.013715:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391460.013770:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1b42 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b037d expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.013962:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.013980:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b036f expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.013991:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.014036:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b036f expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.014052:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b036f expref: 24 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.014070:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51822eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186459520:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391460.014203:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0bcc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391460.022941:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51822eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186459520:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391460.022993:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391460.024793:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.025155:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169613312 00000100:00100000:2.0:1790391460.025170:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169613312 00010000:00010000:2.0:1790391460.025240:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b036f expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.025315:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 85 00000100:00100000:2.0:1790391460.025327:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:2384:x1877361169613312:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391460.025491:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391460.025502:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b036f expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.025518:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b036f expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.025546:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b036f expref: 25 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.025565:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391460.025571:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.025582:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.025591:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.025632:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391460.025706:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:2384:x1877361169613312:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 381us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.025714:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 85 00010000:00010000:1.0:1790391460.026251:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.026262:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391460.026306:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1790391460.026504:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d800/0x2b1b7949f13e1b42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b037d expref: 25 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.026525:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b037d expref: 24 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.026534:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391460.026537:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790391460.026540:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ca00, rc 0) 00000100:00100000:1.0:1790391460.026604:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:12322:x1877361169613184:12345-192.168.202.28@tcp:101:bash.0 Request processed in 12926us (13334us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1790391460.026613:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 175 00000100:00100000:3.0:1790391460.032626:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.032781:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169613568 00000100:00100000:1.0:1790391460.032794:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169613568 00000100:00100000:1.0:1790391460.032874:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 176 00000100:00100000:1.0:1790391460.032908:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:12322:x1877361169613568:12345-192.168.202.28@tcp:36:bash.0 00010000:00010000:1.0:1790391460.033226:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.033248:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.033262:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391460.033330:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1790391460.033383:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008593366b reply state 00000000fae9efe1 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.033398:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.033406:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391460.033409:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391460.033413:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391460.033531:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12322:x1877361169613568:12345-192.168.202.28@tcp:36:bash.0 Request processed in 625us (920us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1790391460.033540:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 176 00000020:00080000:1.0:1790391460.033545:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790391460.039487:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.039777:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169613696 00000100:00100000:1.0:1790391460.039790:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169613696 00000100:00100000:1.0:1790391460.039911:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 177 00000100:00100000:1.0:1790391460.039923:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518404c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12322:x1877361169613696:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:1.0:1790391460.039958:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391460.039988:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0384 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.040157:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.040175:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b037d expref: 28 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.040186:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.040535:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b037d expref: 28 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.040563:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b037d expref: 28 pid: 10091 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391460.040581:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52b76ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186459648:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391460.040696:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391460.043632:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52b76ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186459648:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391460.043671:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391460.044498:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391460.045071:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169613824 00000100:00100000:3.0:1790391460.045085:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169613824 00010000:00010000:3.0:1790391460.045141:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b037d expref: 29 pid: 10091 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391460.045195:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 86 00000100:00100000:3.0:1790391460.045208:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:2384:x1877361169613824:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391460.045228:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391460.045563:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b037d expref: 29 pid: 10091 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.045580:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b037d expref: 29 pid: 10091 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.045637:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1b49 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b037d expref: 29 pid: 10091 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.045659:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:3.0:1790391460.045664:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.045676:0:10388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.045685:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.045771:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391460.045855:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:2384:x1877361169613824:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 648us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391460.045865:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 86 00010000:00010000:1.0:1790391460.047563:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.047585:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391460.047667:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790391460.047672:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391460.047700:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.047752:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0384 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.049135:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0384 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.049149:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391460.049178:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391460.049183:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087000, rc 0) 00000100:00100000:1.0:1790391460.049606:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518404c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12322:x1877361169613696:12345-192.168.202.28@tcp:101:bash.0 Request processed in 9682us (10133us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391460.049616:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 177 00000100:00100000:3.0:1790391460.056010:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.056100:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169614080 00000100:00100000:1.0:1790391460.056114:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169614080 00000100:00100000:1.0:1790391460.056193:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00100000:1.0:1790391460.056206:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12322:x1877361169614080:12345-192.168.202.28@tcp:35:bash.0 00000100:00100000:1.0:1790391460.057512:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:12322:x1877361169614080:12345-192.168.202.28@tcp:35:bash.0 Request processed in 1296us (1503us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1790391460.057526:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00100000:3.0:1790391460.163511:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.163644:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169614336 00000100:00100000:1.0:1790391460.163658:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169614336 00000100:00100000:1.0:1790391460.163743:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 178 00000100:00100000:1.0:1790391460.163755:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:12332:x1877361169614336:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391460.163822:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391460.163850:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b038b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391460.164033:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1790391460.164166:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b038b expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.164183:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b6ca00) 00010000:00010000:1.0:1790391460.164186:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391460.164192:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b038b expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.164229:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086600, rc 0) 00000100:00100000:1.0:1790391460.164319:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:12332:x1877361169614336:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 567us (824us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1790391460.164328:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 178 00000100:00100000:0.0:1790391460.167626:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.167743:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169614464 00000100:00100000:2.0:1790391460.167787:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169614464 00000100:00100000:2.0:1790391460.167867:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 179 00000100:00100000:2.0:1790391460.167922:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:12332:x1877361169614464:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:2.0:1790391460.168031:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1b7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168052:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1b7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168068:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1b7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168086:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1b81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168094:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1b81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168102:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1b81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168200:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168210:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168218:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391460.168281:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168310:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1b7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168317:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1b7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168326:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1b7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168333:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ce00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391460.168338:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1b7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168347:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1b7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168363:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391460.168366:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391460.168372:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1b7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168380:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1b7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168395:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1b81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168402:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1b81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168408:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1b81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168420:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309cc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391460.168423:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1b81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168429:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1b81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168438:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6cb00) 00010000:00010000:2.0:1790391460.168440:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391460.168444:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1b81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168451:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1b81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168468:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168475:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168481:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168487:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391460.168490:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168496:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168515:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391460.168517:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391460.168521:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.168528:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1b88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.168633:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:12332:x1877361169614464:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 754us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.168642:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 179 00000100:00100000:3.0:1790391460.172357:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.172598:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169614720 00000100:00100000:2.0:1790391460.172612:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169614720 00000100:00100000:2.0:1790391460.172695:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:2.0:1790391460.172708:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:12332:x1877361169614720:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:2.0:1790391460.173052:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:12332:x1877361169614720:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 346us (717us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1790391460.173061:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:3.0:1790391460.230785:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.231355:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169614976 00000100:00100000:1.0:1790391460.231369:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169614976 00000100:00100000:1.0:1790391460.231455:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 180 00000100:00100000:1.0:1790391460.231467:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:12335:x1877361169614976:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391460.231499:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391460.231524:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0392 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.231611:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b96 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.231628:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.231640:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.231654:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1b9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.231662:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1b9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.231668:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1b9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.231832:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ba4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.231843:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.231850:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391460.231862:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790391460.232123:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232132:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b96 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232139:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232145:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391460.232150:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232159:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b96 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232174:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:1.0:1790391460.232176:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391460.232181:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232199:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1b96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232215:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1b9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232220:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1b9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232226:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1b9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232231:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391460.232234:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1b9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232240:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1b9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232247:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e5283a48300) 00010000:00010000:1.0:1790391460.232249:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391460.232251:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1b9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232257:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1b9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232301:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1b8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0392 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232314:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0392 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.232327:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391460.232329:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391460.232332:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087200, rc 0) 00000100:00100000:1.0:1790391460.232414:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:12335:x1877361169614976:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 950us (1645us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1790391460.232422:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 180 00000100:00100000:0.0:1790391460.239226:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.239576:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169615104 00000100:00100000:2.0:1790391460.239590:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169615104 00000100:00100000:2.0:1790391460.239676:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 181 00000100:00100000:2.0:1790391460.239688:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:12335:x1877361169615104:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:2.0:1790391460.239802:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.239826:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.239864:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.239952:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.239960:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.239967:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.239974:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391460.239980:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.239989:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.240004:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391460.240007:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391460.240013:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.240020:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.240123:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:12335:x1877361169615104:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 436us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.240132:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 181 00000100:00100000:3.0:1790391460.243411:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391460.243468:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.243733:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169615360 00000100:00100000:2.0:1790391460.243747:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169615360 00000100:00100000:2.0:1790391460.243840:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:2.0:1790391460.243854:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:12335:x1877361169615360:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:0.0:1790391460.243978:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169615488 00000100:00100000:0.0:1790391460.243992:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169615488 00000100:00100000:0.0:1790391460.244037:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:0.0:1790391460.244044:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:2384:x1877361169615488:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391460.244056:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391460.244087:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ba4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0392 expref: 34 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.244131:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:0.0:1790391460.244138:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391460.244332:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:12335:x1877361169615360:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 313us (770us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1790391460.244350:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:0.0:1790391460.246563:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:2384:x1877361169615488:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 2500us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.246588:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:3.0:1790391460.458153:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.458245:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169615744 00000100:00100000:2.0:1790391460.458258:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169615744 00000100:00100000:2.0:1790391460.458347:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 182 00000100:00100000:2.0:1790391460.458361:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:12353:x1877361169615744:12345-192.168.202.28@tcp:101:cat.0 00010000:00010000:2.0:1790391460.458397:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391460.458425:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0399 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.458567:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1bc0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.458587:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1bc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.458600:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1bc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391460.458613:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790391460.458775:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1bb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0399 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.458798:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1bc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0399 expref: 34 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.458826:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391460.458829:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790391460.458835:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ce00, rc 0) 00000100:00100000:2.0:1790391460.458987:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:12353:x1877361169615744:12345-192.168.202.28@tcp:101:cat.0 Request processed in 629us (850us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1790391460.458995:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 182 00000100:00100000:2.0:1790391460.480338:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.480470:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169615872 00000100:00100000:1.0:1790391460.480485:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169615872 00000100:00100000:1.0:1790391460.480565:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 183 00000100:00100000:1.0:1790391460.480576:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:12354:x1877361169615872:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391460.480608:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391460.480638:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1bce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03a0 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.480865:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1bd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.480928:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.480942:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391460.481014:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790391460.481018:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391460.481042:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.481101:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1bce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a0 expref: 36 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.481122:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a0 expref: 35 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.481131:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:1.0:1790391460.481135:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391460.481139:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086000, rc 0) 00000100:00100000:1.0:1790391460.481219:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12354:x1877361169615872:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 644us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391460.481227:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 183 00000100:00100000:1.0:1790391460.497038:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.497289:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169616256 00000100:00100000:0.0:1790391460.497303:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169616256 00000100:00100000:0.0:1790391460.497383:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 48 00000100:00100000:0.0:1790391460.497396:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12354:x1877361169616256:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:0.0:1790391460.497799:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:12354:x1877361169616256:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 405us (775us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1790391460.497808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 48 00000100:00100000:3.0:1790391460.501546:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.501671:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169616384 00000100:00100000:1.0:1790391460.501687:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169616384 00000100:00100000:1.0:1790391460.501792:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:1.0:1790391460.501804:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:12354:x1877361169616384:12345-192.168.202.28@tcp:103:lfs.0 00010000:00010000:1.0:1790391460.501824:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790391460.501859:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1b65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0384 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.501922:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1bc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0399 expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.501937:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1a5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b033e expref: 34 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.501974:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391460.501981:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391460.502210:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:12354:x1877361169616384:12345-192.168.202.28@tcp:103:lfs.0 Request processed in 406us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391460.502220:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:1.0:1790391460.521092:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.521773:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169616512 00000100:00100000:2.0:1790391460.521790:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169616512 00000100:00100000:2.0:1790391460.521913:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 184 00000100:00100000:2.0:1790391460.521927:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:12354:x1877361169616512:12345-192.168.202.28@tcp:58:lfs.0 00010000:00010000:2.0:1790391460.522077:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1bdc lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.522100:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1bdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.522126:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1bdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391460.522273:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1790391460.522659:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:12354:x1877361169616512:12345-192.168.202.28@tcp:58:lfs.0 Request processed in 734us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.522667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 184 00000100:00100000:2.0:1790391460.558067:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.561282:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169616640 00000100:00100000:1.0:1790391460.561306:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169616640 00000100:00100000:0.0:1790391460.561513:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 185 00000100:00100000:0.0:1790391460.561527:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+33:12356:x1877361169616640:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391460.561555:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391460.561584:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1be3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03a7 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.561673:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1bea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.561692:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1bea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.561718:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1bea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.561770:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1bf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.561779:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.561786:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.561910:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.561922:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.561930:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391460.561986:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790391460.561991:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391460.562019:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562035:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562044:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1bea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562051:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1bea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562069:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1bea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562076:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391460.562081:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1bea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562091:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1bea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562120:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391460.562124:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391460.562130:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1bea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562137:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1bea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562153:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562161:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1bf1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562168:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562174:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391460.562177:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562194:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562203:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e5182c83300) 00010000:00010000:0.0:1790391460.562205:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391460.562208:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1bf1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562214:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1bf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562257:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1be3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a7 expref: 35 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562272:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a7 expref: 34 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.562279:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:0.0:1790391460.562282:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391460.562285:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefa00, rc 0) 00000100:00100000:0.0:1790391460.562385:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:12356:x1877361169616640:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 860us (4333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.562393:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 185 00000040:00080000:1.0:1790391460.681344:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391460.681358:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391460.681395:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1790391460.681408:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391460.681597:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186459776:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391460.682008:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391460.694363:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.702108:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186459776:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790391460.702373:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169616768 00000100:00100000:0.0:1790391460.702384:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169616768 00000100:00100000:0.0:1790391460.702467:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 186 00000100:00100000:0.0:1790391460.702477:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:12367:x1877361169616768:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790391460.702544:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790391460.702712:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:12367:x1877361169616768:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 234us (8365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.702721:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 186 00000100:00100000:2.0:1790391460.725556:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.725708:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169616896 00000100:00100000:0.0:1790391460.725723:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169616896 00000100:00100000:0.0:1790391460.725821:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 187 00000100:00100000:0.0:1790391460.725835:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:12367:x1877361169616896:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790391460.725980:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1bff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.726014:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1bff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.726033:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1bff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.731838:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1c06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.731863:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1c06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.731983:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1c06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732029:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732039:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732065:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391460.732125:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790391460.732129:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391460.732144:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732157:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1bff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732164:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1bff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732171:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1bff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732177:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391460.732181:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1bff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732188:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1bff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732200:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:0.0:1790391460.732203:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391460.732208:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1bff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732214:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1bff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732303:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1c06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732427:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1c06 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732433:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1c06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732438:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391460.732440:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1c06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732446:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1c06 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732453:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9e5182c83300) 00010000:00010000:0.0:1790391460.732456:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391460.732458:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1c06 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732463:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1c06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732481:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732488:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732494:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732505:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391460.732508:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732514:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732522:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:0.0:1790391460.732524:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391460.732527:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.732533:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391460.732831:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:12367:x1877361169616896:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 Request processed in 6994us (7287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.732844:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 187 00000100:00100000:1.0:1790391460.741910:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.741991:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169617152 00000100:00100000:0.0:1790391460.742012:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169617152 00000100:00100000:0.0:1790391460.742426:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 188 00000100:00100000:0.0:1790391460.742434:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:12367:x1877361169617152:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391460.742452:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391460.742471:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1c14 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03ae expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742573:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742604:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742617:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391460.742630:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790391460.742711:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742718:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742724:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742731:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391460.742737:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742745:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742767:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:0.0:1790391460.742771:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391460.742776:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c1b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742783:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742826:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1c14 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ae expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742839:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:0.0:1790391460.742841:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391460.742844:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1c14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ae expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.742850:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef800, rc 0) 00000100:00100000:0.0:1790391460.742942:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12367:x1877361169617152:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 508us (1052us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1790391460.742947:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 188 00000100:00100000:2.0:1790391460.746561:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.746613:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.746645:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.746677:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169617664 00000100:00100000:2.0:1790391460.746687:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169617664 00000100:00100000:0.0:1790391460.746770:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169617408 00000100:00100000:2.0:1790391460.746780:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 161 00000100:00100000:0.0:1790391460.746784:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169617408 00000100:00100000:2.0:1790391460.746802:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169617664:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391460.746860:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 326 00000100:00100000:0.0:1790391460.746874:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169617408:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391460.746941:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169617664:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 143us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.746952:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 161 00000100:00080000:2.0:1790391460.746985:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391460.746991:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391460.747015:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169617408:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 140us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.747024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 326 00000100:00100000:2.0:1790391460.747221:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.747267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169617920 00000100:00100000:0.0:1790391460.747275:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169617920 00000100:00100000:2.0:1790391460.747314:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.747343:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 327 00000100:00080000:2.0:1790391460.747346:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391460.747359:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169617920:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391460.747367:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169617536 00000100:00100000:2.0:1790391460.747375:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169617536 00000100:00100000:0.0:1790391460.747402:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169617920:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 47us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.747410:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 327 00000100:00100000:2.0:1790391460.747427:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 162 00000100:00100000:2.0:1790391460.747438:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169617536:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391460.747476:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2383:x1877361169617536:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 41us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.747483:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 162 00000100:00080000:2.0:1790391460.747504:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391460.747563:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.747660:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169617792 00000100:00100000:2.0:1790391460.747664:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169617792 00000100:00100000:2.0:1790391460.747703:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 328 00000100:00100000:2.0:1790391460.747710:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169617792:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391460.747768:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169617792:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 58us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.747776:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 328 00000100:00080000:2.0:1790391460.747792:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391460.748188:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.748223:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169617280 00000100:00100000:1.0:1790391460.748237:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169617280 00000100:00100000:1.0:1790391460.748276:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 391 00000100:00100000:1.0:1790391460.748284:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169617280:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391460.748321:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169617280:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 37us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391460.748327:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 391 00000100:00100000:0.0:1790391460.749775:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169618048 00000100:00100000:0.0:1790391460.749816:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169618048 00000100:00100000:0.0:1790391460.749920:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 189 00000100:00100000:0.0:1790391460.749937:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12367:x1877361169618048:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790391460.749983:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790391460.750143:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12367:x1877361169618048:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 212us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.750152:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 189 00000100:00100000:1.0:1790391460.758992:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.759620:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169618304 00000100:00100000:2.0:1790391460.759632:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169618304 00000100:00100000:2.0:1790391460.759715:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 190 00000100:00100000:2.0:1790391460.759727:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12367:x1877361169618304:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391460.759759:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391460.759763:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790391460.759791:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086000/0x2b1b7949f13e1bd5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a0 expref: 35 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.759821:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391460.759826:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391460.759840:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c29 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391460.760438:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1790391460.760724:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1c30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.760739:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1c30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.760749:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1c30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.761143:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03b5 expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.761163:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1c30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03b5 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.761172:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e52b9b6cb00) 00010000:00010000:2.0:1790391460.761175:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391460.761177:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ce00, rc 0) 00000100:00100000:2.0:1790391460.762142:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:12367:x1877361169618304:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 2411us (3154us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1790391460.762154:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 190 00000100:00100000:2.0:1790391460.769540:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.769846:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169618560 00000100:00100000:0.0:1790391460.769858:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169618560 00000100:00100000:0.0:1790391460.770146:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 191 00000100:00100000:0.0:1790391460.770159:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:12367:x1877361169618560:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790391460.770221:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391460.770251:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1c30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03b5 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770273:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e52b9b6cb00) 00010000:00010000:0.0:1790391460.770286:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391460.770312:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c3e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770327:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c3e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770339:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c3e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770389:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x387867d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770424:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x387867d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770433:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x387867d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770495:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c3e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770503:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c3e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770511:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c3e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770518:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391460.770524:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c3e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770534:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c3e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770552:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391460.770556:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391460.770560:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c3e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770566:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c3e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770577:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x387867d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770591:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c45 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x387867d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770598:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x387867d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770603:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391460.770606:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x387867d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770612:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c45 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x387867d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770620:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x387867d8 (ffff9e5182c83300) 00010000:00010000:0.0:1790391460.770623:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391460.770626:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c45 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x387867d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.770633:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c45 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x387867d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391460.770722:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12367:x1877361169618560:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 565us (1193us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391460.770730:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 191 00000100:00100000:2.0:1790391460.777507:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.777592:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169618688 00000100:00100000:0.0:1790391460.777601:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169618688 00000100:00100000:0.0:1790391460.777665:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 192 00000100:00100000:0.0:1790391460.777675:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12367:x1877361169618688:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391460.777695:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391460.777731:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1c4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03bc expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.777796:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.777811:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.777824:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.777987:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1c4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03bc expref: 37 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.778006:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03bc expref: 36 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.778015:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:0.0:1790391460.778030:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790391460.778034:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee200, rc 0) 00000100:00100000:0.0:1790391460.778102:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:12367:x1877361169618688:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 428us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.778108:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 192 00000100:00100000:1.0:1790391460.783548:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.785322:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169618944 00000100:00100000:2.0:1790391460.785345:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169618944 00000100:00100000:2.0:1790391460.785606:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 193 00000100:00100000:2.0:1790391460.785621:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+36:12367:x1877361169618944:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790391460.785770:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.785793:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.785809:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391460.786099:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1790391460.786111:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374153233258ns, next at 375153229668ns, rc = 0 00000004:00010000:2.0:1790391460.786178:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001027a4fd reply state 000000007965d1e7 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.786193:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.786202:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:2.0:1790391460.786205:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790391460.786211:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391460.786351:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:12367:x1877361169618944:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 731us (2815us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1790391460.786359:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 193 00000100:00100000:1.0:1790391460.794511:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.795686:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169619072 00000100:00100000:0.0:1790391460.795703:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169619072 00000100:00100000:0.0:1790391460.795800:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 194 00000100:00100000:0.0:1790391460.795812:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:12367:x1877361169619072:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790391460.795836:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391460.795871:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03c3 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.796146:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03c3 expref: 39 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.796162:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03c3 expref: 39 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.796180:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:0.0:1790391460.796184:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391460.796188:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefe00, rc 0) 00000100:00100000:0.0:1790391460.796256:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:12367:x1877361169619072:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 447us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.796264:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 194 00000100:00100000:3.0:1790391460.807422:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.807748:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169619200 00000100:00100000:1.0:1790391460.807773:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169619200 00000100:00100000:1.0:1790391460.807859:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:1.0:1790391460.807873:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+6:2384:x1877361169619200:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790391460.808234:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169619200:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 363us (827us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790391460.808244:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 59 00010000:00010000:1.0:1790391460.809178:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391460.810492:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.810579:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169619456 00000100:00100000:0.0:1790391460.810590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169619456 00000100:00100000:0.0:1790391460.810660:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 49 00000100:00100000:0.0:1790391460.810671:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:12367:x1877361169619456:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790391460.811288:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:12367:x1877361169619456:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 615us (803us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1790391460.811298:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 49 00000100:00100000:3.0:1790391460.824555:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.824660:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169619712 00000100:00100000:2.0:1790391460.824674:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169619712 00000100:00100000:2.0:1790391460.824781:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 195 00000100:00100000:2.0:1790391460.824796:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:12367:x1877361169619712:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790391460.825131:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:12367:x1877361169619712:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 183us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.825142:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 195 00000100:00100000:3.0:1790391460.829067:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.838045:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169619840 00000100:00100000:2.0:1790391460.838069:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169619840 00000100:00100000:2.0:1790391460.838162:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 196 00000100:00100000:2.0:1790391460.838175:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:12367:x1877361169619840:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391460.838202:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391460.838241:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1c68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.838366:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1c6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.838384:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1c6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.838398:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1c6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391460.838467:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391460.838492:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1c6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.838527:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1c68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ca expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.838548:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1c6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ca expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.838559:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:2.0:1790391460.838562:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790391460.838566:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309cc00, rc 0) 00000100:00100000:2.0:1790391460.838668:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+41:12367:x1877361169619840:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 496us (9619us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.838677:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 196 00000100:00100000:1.0:1790391460.844784:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391460.845182:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169619968 00000100:00100000:3.0:1790391460.845196:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169619968 00000100:00100000:3.0:1790391460.845273:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:3.0:1790391460.845285:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169619968:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391460.845310:0:10505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391460.845401:0:10505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007361e486/0x2b1b7949f13e1c76 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03d1 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790391460.845445:0:10505:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab734a5, blocks: 0x0 00010000:00010000:3.0:1790391460.845473:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1790391460.845477:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391460.845489:0:10505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007361e486/0x2b1b7949f13e1c76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d1 expref: 8 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.845512:0:10505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007361e486/0x2b1b7949f13e1c76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d1 expref: 8 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.845528:0:10505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763de00, rc 0) 00000100:00100000:3.0:1790391460.845611:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169619968:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 328us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391460.845619:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:2.0:1790391460.859420:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391460.859526:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169620224 00000100:00100000:3.0:1790391460.859539:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169620224 00000100:00100000:3.0:1790391460.859617:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 197 00000100:00100000:3.0:1790391460.859629:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+41:12367:x1877361169620224:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790391460.859795:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+41:12367:x1877361169620224:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 167us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391460.859815:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 197 00000100:00100000:3.0:1790391460.866052:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.866520:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169620352 00000100:00100000:2.0:1790391460.866550:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169620352 00000100:00100000:2.0:1790391460.866630:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:2.0:1790391460.866642:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:12367:x1877361169620352:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391460.866665:0:9796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391460.866687:0:9796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03d8 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.866726:0:9796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007361e486/0x2b1b7949f13e1c76 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d1 expref: 9 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.866736:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391460.866741:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391460.866747:0:9796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 9 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.866801:0:9796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007361e486/0x2b1b7949f13e1c76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d1 expref: 9 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.866818:0:9796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007361e486/0x2b1b7949f13e1c76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d1 expref: 9 pid: 10505 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.866833:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9796:1877361186459904:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391460.866962:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0bcc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391460.868854:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9796:1877361186459904:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391460.868919:0:9796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 9 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.868960:0:9796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ce00, rc 0) 00000100:00100000:2.0:1790391460.869018:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:12367:x1877361169620352:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 2377us (2979us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.869027:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:3.0:1790391460.870223:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.870388:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169620480 00000100:00100000:2.0:1790391460.870399:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169620480 00010000:00010000:2.0:1790391460.870451:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007361e486/0x2b1b7949f13e1c76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d1 expref: 9 pid: 10505 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.870489:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 87 00000100:00100000:2.0:1790391460.870498:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2383:x1877361169620480:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391460.870517:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391460.870547:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007361e486/0x2b1b7949f13e1c76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d1 expref: 9 pid: 10505 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.870562:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007361e486/0x2b1b7949f13e1c76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d1 expref: 9 pid: 10505 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.870589:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007361e486/0x2b1b7949f13e1c76 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d1 expref: 9 pid: 10505 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.870605:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391460.870610:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391460.870620:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 8 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.870642:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 8 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.870690:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 8 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.870707:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b0bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1877361186460032:192.168.202.28@tcp:105: 00000100:00100000:2.0:1790391460.870806:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0bcc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391460.872122:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186460160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391460.872197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391460.872420:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186460160 00000100:00100000:2.0:1790391460.872429:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186460160 00000100:00100000:2.0:1790391460.872497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790391460.872508:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186460160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391460.872552:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790391460.872621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186460160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.872628:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790391460.872711:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186460160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391460.874964:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391460.874992:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186460288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391460.875081:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391460.875148:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186460288 00000100:00100000:3.0:1790391460.875159:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186460288 00000100:00100000:3.0:1790391460.875222:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790391460.875233:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186460288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391460.875273:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790391460.875328:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186460288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391460.875337:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790391460.875396:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186460288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391460.880328:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b0bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6498:1877361186460032:192.168.202.28@tcp:105: 00010000:00010000:3.0:1790391460.880390:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391460.880463:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169620480:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 9963us (10244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391460.880477:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 87 00000100:00100000:3.0:1790391460.882533:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186460416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391460.882631:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391460.884498:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186460416 00000100:00100000:2.0:1790391460.884515:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186460416 00000100:00100000:2.0:1790391460.884600:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790391460.884613:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186460416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391460.884648:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790391460.887116:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186460416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2495us (4474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.887135:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790391460.888468:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.888533:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169620608 00000100:00100000:0.0:1790391460.888545:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169620608 00002000:00100000:0.0:1790391460.888607:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9e51838f5880 x1877361169620608/t0(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:326/0 lens 504/0 e 0 to 0 dl 1790391471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391460.888629:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e51838f5880 with x1877361169620608 ext(0->8) 00002000:00010000:0.0:1790391460.888637:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e51838f5880 00000100:00100000:0.0:1790391460.888669:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:0.0:1790391460.888681:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169620608:12345-192.168.202.28@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790391460.890007:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186460416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391460.890092:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:2383:x1877361169620608:12345-192.168.202.28@tcp:4:lhsmtool_posix.0 Request processed in 1411us (1632us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1790391460.890102:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 4 00002000:00100000:0.0:1790391460.890112:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9e51838f5880 x1877361169620608/t4294967315(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:326/0 lens 504/448 e 0 to 0 dl 1790391471 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391460.890123:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e51838f5880 with x1877361169620608 ext(0->8) 00002000:00010000:0.0:1790391460.890129:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e51838f5880 00000100:00100000:1.0:1790391460.897059:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.900022:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169620736 00000100:00100000:0.0:1790391460.900044:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169620736 00000100:00100000:0.0:1790391460.900190:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 198 00000100:00100000:0.0:1790391460.900205:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+41:12367:x1877361169620736:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790391460.904560:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1790391460.904580:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1790391460.904620:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1790391460.904828:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:12367:x1877361169620736:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 Request processed in 4618us (7775us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.904841:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 198 00010000:00010000:2.0:1790391460.904947:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.904962:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.904971:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.904978:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391460.904984:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.904994:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905015:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391460.905018:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391460.905025:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905032:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1b11 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905050:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905056:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905062:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905081:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391460.905084:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905091:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905100:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391460.905102:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391460.905105:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905111:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e1b57 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905124:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905130:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905136:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905142:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391460.905145:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905151:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905170:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:2.0:1790391460.905172:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790391460.905176:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.905182:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1c5a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.905307:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186460544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790391460.905398:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391460.905464:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186460544 00000100:00100000:2.0:1790391460.905471:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186460544 00000100:00100000:2.0:1790391460.905522:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790391460.905531:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b9f42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186460544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790391460.905688:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790391460.905692:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790391461 00002000:00010000:2.0:1790391460.905695:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790391460.905697:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790391461 -> 1790391461 00002000:00010000:2.0:1790391460.905700:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1790391460.905734:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b9f42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186460544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (336us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790391460.905741:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1790391460.911459:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5183b08700/2, rc 0, transno 4294967316 00000100:00100000:2.0:1790391460.911484:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186460544:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1790391460.911682:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1790391460.911700:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1790391460.919577:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.923983:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169620864 00000100:00100000:1.0:1790391460.924010:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169620864 00000100:00100000:1.0:1790391460.924115:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:1.0:1790391460.924128:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:2384:x1877361169620864:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790391460.925850:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1790391460.925869:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1790391460.926141:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169620864:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 Request processed in 2008us (6573us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391460.926153:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:3.0:1790391460.930486:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391460.930680:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169621120 00000100:00100000:0.0:1790391460.930693:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169621120 00000100:00100000:0.0:1790391460.930799:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 199 00000100:00100000:0.0:1790391460.930829:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:12367:x1877361169621120:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790391460.930934:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391460.930970:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1c6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ca expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.930994:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:0.0:1790391460.931001:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391460.931043:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.931061:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.931073:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391460.931247:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010dc93a8 reply state 00000000851295a9 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.931263:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.931269:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:0.0:1790391460.931273:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790391460.931275:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790391460.931419:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:12367:x1877361169621120:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 591us (946us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1790391460.931427:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 199 00000100:00100000:3.0:1790391460.935709:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.935915:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169621248 00000100:00100000:2.0:1790391460.935928:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169621248 00000100:00100000:2.0:1790391460.936010:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:2.0:1790391460.936041:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169621248:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790391460.936270:0:9796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790391460.936275:0:9796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790391461 -> 1790391460 00002000:00010000:2.0:1790391460.936278:0:9796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790391459 00002000:00010000:2.0:1790391460.936280:0:9796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790391461 -> 1790391460 00002000:00010000:2.0:1790391460.936282:0:9796:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1790391460.936443:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169621248:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 405us (749us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1790391460.936452:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:0.0:1790391460.939015:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391460.941366:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169621504 00000100:00100000:3.0:1790391460.941390:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169621504 00000100:00100000:3.0:1790391460.941551:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 200 00000100:00100000:3.0:1790391460.941563:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:12367:x1877361169621504:12345-192.168.202.28@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790391460.941663:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.941686:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03bc expref: 20 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.941697:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.941745:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03bc expref: 20 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.941773:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03bc expref: 20 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391460.941794:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b57100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186460672:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391460.941980:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183898000 going to sleep for 11 seconds 00000100:00100000:3.0:1790391460.952394:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b57100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186460672:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391460.952438:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391460.952869:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391460.953146:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169621632 00000100:00100000:1.0:1790391460.953156:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169621632 00010000:00010000:1.0:1790391460.953204:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03bc expref: 21 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391460.953244:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 88 00000100:00100000:1.0:1790391460.953255:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:2383:x1877361169621632:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391460.953285:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391460.953295:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03bc expref: 21 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.953311:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03bc expref: 21 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.953341:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1c53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03bc expref: 21 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.953361:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:1.0:1790391460.953367:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.953381:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.953391:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391460.953429:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391460.953517:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:2383:x1877361169621632:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 262us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391460.953526:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 88 00010000:00010000:2.0:1790391460.954083:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.954095:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.954147:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.954156:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.954163:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.954170:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391460.954176:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.954184:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.954207:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:2.0:1790391460.954210:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790391460.954215:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.954222:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1c8b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.954296:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:12367:x1877361169621504:12345-192.168.202.28@tcp:55:lhsmtool_posix.0 Request processed in 12734us (15294us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790391460.954305:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 200 00000100:00100000:0.0:1790391460.957859:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.958041:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169621760 00000100:00100000:2.0:1790391460.958055:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169621760 00000100:00100000:2.0:1790391460.958138:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:2.0:1790391460.958151:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169621760:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790391460.958208:0:10505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.958232:0:10505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 8 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.958243:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391460.958247:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391460.958252:0:10505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.958288:0:10505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 8 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.958318:0:10505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 8 pid: 9796 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.958332:0:10505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10505:1877361186460800:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391460.958448:0:10505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0bcc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391460.968626:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391460.969267:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169621888 00000100:00100000:3.0:1790391460.969281:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169621888 00010000:00010000:3.0:1790391460.969352:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 9 pid: 9796 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391460.969415:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 89 00000100:00100000:3.0:1790391460.969426:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2383:x1877361169621888:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391460.969446:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391460.969479:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 9 pid: 9796 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.969496:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 9 pid: 9796 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.969530:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391460.969535:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391460.969543:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.969557:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.969611:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391460.969722:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2383:x1877361169621888:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 297us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391460.969730:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 89 00010000:00010000:2.0:1790391460.971811:0:10505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ac29b15/0x2b1b7949f13e1c7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03d8 expref: 8 pid: 9796 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.971840:0:10505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10505:1877361186460800:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391460.971943:0:10505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.971956:0:10505:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.971964:0:10505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.971999:0:10505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.972006:0:10505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.972042:0:10505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.972049:0:10505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391460.972054:0:10505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.972063:0:10505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.972085:0:10505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.972094:0:10505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000344873b3/0x2b1b7949f13e1c92 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.972229:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169621760:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 Request processed in 14079us (14382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.972239:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:2.0:1790391460.978194:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391460.978515:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169622144 00000100:00100000:3.0:1790391460.978529:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169622144 00000100:00100000:3.0:1790391460.978609:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 201 00000100:00100000:3.0:1790391460.978623:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:12367:x1877361169622144:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790391460.978736:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.978769:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0361 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.978781:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.978834:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0361 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.978852:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0361 expref: 19 pid: 6512 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391460.978872:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b57100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186460928:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391460.979012:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183898000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391460.981908:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391460.982323:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169622272 00000100:00100000:2.0:1790391460.982346:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169622272 00010000:00010000:2.0:1790391460.982410:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0361 expref: 20 pid: 6512 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391460.982494:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 90 00000100:00100000:2.0:1790391460.982508:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:2383:x1877361169622272:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391460.982529:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391460.982538:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0361 expref: 20 pid: 6512 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.982553:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0361 expref: 20 pid: 6512 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.982580:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391460.982587:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.982600:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.982608:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391460.982632:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391460.982709:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:2383:x1877361169622272:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 204us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391460.982717:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 90 00010000:00010000:3.0:1790391460.983001:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1ae0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0361 expref: 19 pid: 6512 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391460.983030:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b57100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186460928:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391460.983056:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.983066:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.983072:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.983323:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.983335:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c61 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03c3 expref: 19 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.983345:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.983378:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03c3 expref: 19 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391460.983395:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c61 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03c3 expref: 19 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391460.983409:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b57100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186461056:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391460.983494:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183898600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391460.991541:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391460.991829:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b57100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186461056:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391460.991871:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391460.994691:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169622400 00000100:00100000:1.0:1790391460.994712:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169622400 00010000:00010000:1.0:1790391460.994799:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c61 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03c3 expref: 20 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391460.994999:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 91 00000100:00100000:0.0:1790391460.995017:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:2384:x1877361169622400:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391460.995041:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391460.995050:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c61 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03c3 expref: 20 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.995069:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03c3 expref: 20 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.995113:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1c61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03c3 expref: 20 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.995140:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:0.0:1790391460.995147:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.995160:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.995171:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391460.995263:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391460.995366:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:2384:x1877361169622400:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 355us (3840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391460.995386:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 91 00010000:00010000:3.0:1790391461.000052:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.000150:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391461.000443:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1790391461.000607:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1790391461.000655:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1790391461.000784:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186461184:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790391461.000915:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.000970:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528a1bbe40 going to sleep for 10 seconds 00000100:00100000:1.0:1790391461.004939:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186461184 00000100:00100000:1.0:1790391461.004962:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186461184 00000100:00100000:1.0:1790391461.005078:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790391461.005094:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1877361186461184:12345-0@lo:1000:mdt00_000.0 00000100:00080000:2.0:1790391461.005215:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391461.005282:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1877361186461184:12345-0@lo:1000:mdt00_000.0 Request processed in 193us (4366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391461.005291:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790391461.005427:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1790391461.005436:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5183b08700, transno 4294967316 00000100:00100000:0.0:1790391461.005497:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186461184:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790391461.005701:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1790391461.005817:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186461312:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790391461.005869:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391461.005926:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822dfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391461.008767:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186461312 00000100:00100000:3.0:1790391461.008794:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186461312 00000100:00100000:3.0:1790391461.008937:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1790391461.008952:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1877361186461312:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790391461.009458:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1877361186461312:12345-0@lo:1000:mdt00_000.0 Request processed in 509us (3586us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1790391461.009468:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790391461.013295:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186461312:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790391461.013379:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013392:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013402:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013409:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391461.013415:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013440:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013461:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:1.0:1790391461.013465:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391461.013471:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013504:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d400/0x2b1b7949f13e1ca0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013541:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1bdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013547:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1bdc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013553:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1bdc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013558:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391461.013562:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1bdc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013568:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1bdc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013576:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391461.013578:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391461.013582:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1bdc lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013587:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1bdc lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013616:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013634:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a7 expref: 22 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013654:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013704:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a7 expref: 22 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391461.013724:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a7 expref: 22 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391461.013742:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186461440:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391461.013905:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76850c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391461.022957:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186461440:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391461.023000:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391461.035526:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391461.035773:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169622528 00000100:00100000:2.0:1790391461.035787:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169622528 00010000:00010000:2.0:1790391461.035870:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a7 expref: 23 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391461.035952:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 92 00000100:00100000:2.0:1790391461.035974:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:2383:x1877361169622528:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391461.035995:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391461.036003:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a7 expref: 23 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036022:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a7 expref: 23 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036049:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1bf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03a7 expref: 23 pid: 10091 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036068:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391461.036074:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036085:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036095:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036127:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391461.036212:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:2383:x1877361169622528:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 249us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.036221:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 92 00010000:00010000:2.0:1790391461.036362:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036372:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036386:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036393:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036400:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036406:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391461.036411:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036420:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036429:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391461.036432:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391461.036437:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036443:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1ca7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036466:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036473:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036479:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036484:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391461.036487:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036494:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036501:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391461.036503:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391461.036505:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.036512:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d000/0x2b1b7949f13e1c99 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391461.036686:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:12367:x1877361169622144:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 58065us (58506us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1790391461.036695:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 201 00000020:00080000:2.0:1790391461.036699:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00080000:3.0:1790391461.036988:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1790391461.038182:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391461.038192:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391461.038734:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1790391461.038747:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391461.040477:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391461.040572:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169622784 00000100:00100000:3.0:1790391461.040585:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169622784 00000100:00100000:3.0:1790391461.040658:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 50 00000100:00100000:3.0:1790391461.040669:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:12367:x1877361169622784:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790391461.041089:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790391461.041141:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1790391461.041185:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.041207:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.041246:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.041257:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.041263:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.041271:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.041299:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790391461.041426:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:12367:x1877361169622784:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 756us (959us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1790391461.041435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 50 00000020:00080000:3.0:1790391461.041441:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790391461.041988:0:13724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391461.042000:0:13724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.042018:0:13724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763de00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391461.042024:0:13724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.042034:0:13724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.042051:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:2.0:1790391461.042055:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790391461.042061:0:13724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.042068:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763de00/0x2b1b7949f13e1cae lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.042084:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391461.042086:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391461.042088:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790391461.560589:0:14703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391461.560673:0:14703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391461.560706:0:14703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1790391461.560713:0:14703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790391461.689734:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391461.689824:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169623040 00000100:00100000:0.0:1790391461.689834:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169623040 00000100:00100000:0.0:1790391461.689926:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 202 00000100:00100000:0.0:1790391461.689938:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:12377:x1877361169623040:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391461.689965:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391461.689988:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1cb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03df expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.690103:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1cbc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.690130:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1cbc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.690144:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1cbc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391461.690155:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790391461.690260:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1cb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03df expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.690278:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1cbc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03df expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.690287:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391461.690291:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790391461.690294:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef200, rc 0) 00000100:00100000:0.0:1790391461.690372:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:12377:x1877361169623040:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 436us (647us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1790391461.690380:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 202 00000100:00100000:3.0:1790391461.693193:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391461.693351:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169623168 00000100:00100000:0.0:1790391461.693361:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169623168 00000100:00100000:0.0:1790391461.693412:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 203 00000100:00100000:0.0:1790391461.693422:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:12377:x1877361169623168:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:0.0:1790391461.693500:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1cca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693517:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1cca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693543:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1cca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693561:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1cd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693569:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693575:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693652:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693660:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693667:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391461.693716:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693730:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1cca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693739:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1cca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693758:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1cca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693773:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefa00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391461.693779:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1cca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693787:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1cca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693800:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391461.693803:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391461.693807:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1cca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693813:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1cca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693827:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693833:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693839:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693844:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391461.693846:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693852:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693871:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e5182c85e00) 00010000:00010000:0.0:1790391461.693873:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391461.693910:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1cd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693916:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1cd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693932:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693938:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693944:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693949:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eeee00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391461.693952:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693957:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693965:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e5182c85700) 00010000:00010000:0.0:1790391461.693967:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391461.693970:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.693975:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1cd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391461.694068:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:12377:x1877361169623168:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 646us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.694076:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 203 00000100:00100000:0.0:1790391461.745775:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391461.745852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169623424 00000100:00100000:3.0:1790391461.745863:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169623424 00000100:00100000:3.0:1790391461.745958:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 204 00000100:00100000:3.0:1790391461.745969:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:12380:x1877361169623424:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:3.0:1790391461.745993:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391461.746012:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1cdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03e6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746088:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e1ce6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746121:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e1ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746133:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e1ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746149:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1ced lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746156:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746163:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746290:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746299:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746307:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391461.746317:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790391461.746636:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e1ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746645:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e1ce6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746652:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e1ce6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746665:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391461.746670:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e1ce6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746678:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e1ce6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746690:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:3.0:1790391461.746694:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391461.746698:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e1ce6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746704:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c000/0x2b1b7949f13e1ce6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746717:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746723:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1ced lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746729:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1ced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746734:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391461.746736:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1ced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746752:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1ced lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746772:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e51821bae00) 00010000:00010000:3.0:1790391461.746774:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391461.746777:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1ced lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746783:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1ced lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746843:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1cdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03e6 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.746856:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03e6 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.747040:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:3.0:1790391461.747044:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391461.747049:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d600, rc 0) 00000100:00100000:3.0:1790391461.747158:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12380:x1877361169623424:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 1190us (1394us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1790391461.747166:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 204 00000100:00100000:3.0:1790391461.751587:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391461.751667:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169623552 00000100:00100000:0.0:1790391461.751676:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169623552 00000100:00100000:0.0:1790391461.751732:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 205 00000100:00100000:0.0:1790391461.751754:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12380:x1877361169623552:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:0.0:1790391461.751828:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.751847:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.751860:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.751930:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.751937:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.751944:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.751951:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391461.751956:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.751978:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.751991:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:0.0:1790391461.751995:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391461.752000:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.752007:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391461.752080:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12380:x1877361169623552:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 337us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.752089:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 205 00000100:00100000:0.0:1790391461.757559:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391461.757799:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169623808 00000100:00100000:3.0:1790391461.757809:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169623808 00000100:00100000:3.0:1790391461.757913:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:3.0:1790391461.757925:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12380:x1877361169623808:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:3.0:1790391461.758137:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:12380:x1877361169623808:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 214us (588us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1790391461.758158:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:3.0:1790391461.801010:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391461.801050:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169624064 00000100:00100000:3.0:1790391461.801060:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169624064 00000100:00100000:3.0:1790391461.801112:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 206 00000100:00100000:3.0:1790391461.801121:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:11913:x1877361169624064:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:3.0:1790391461.801145:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391461.801171:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d09 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03ed expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.801290:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.801305:0:10091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03e6 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.801313:0:10091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.801511:0:10091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03e6 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.801526:0:10091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03e6 expref: 29 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391461.801540:0:10091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b54380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186461568:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391461.801620:0:10091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727300 going to sleep for 11 seconds 00000100:00100000:1.0:1790391461.808208:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391461.808458:0:10091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b54380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10091:1877361186461568:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391461.808484:0:10091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391461.808640:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169624192 00000100:00100000:3.0:1790391461.808648:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169624192 00010000:00010000:3.0:1790391461.808686:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03e6 expref: 30 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391461.808731:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 93 00000100:00100000:3.0:1790391461.808752:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:2383:x1877361169624192:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391461.808769:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391461.808776:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03e6 expref: 30 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.808790:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03e6 expref: 30 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.808812:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1cf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03e6 expref: 30 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.808828:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:3.0:1790391461.808832:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.808842:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.808850:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.808922:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391461.808972:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:2383:x1877361169624192:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 231us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391461.808980:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 93 00010000:00010000:3.0:1790391461.809580:0:10091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.809591:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391461.809610:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790391461.809754:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d09 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ed expref: 30 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.809771:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ed expref: 29 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.809778:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:3.0:1790391461.809781:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790391461.809784:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c400, rc 0) 00000100:00100000:3.0:1790391461.809822:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:11913:x1877361169624064:12345-192.168.202.28@tcp:101:bash.0 Request processed in 8701us (8822us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1790391461.809829:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 206 00000100:00100000:1.0:1790391461.816317:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391461.816392:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169624320 00000100:00100000:0.0:1790391461.816402:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169624320 00000100:00100000:0.0:1790391461.816466:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 207 00000100:00100000:0.0:1790391461.816477:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:11913:x1877361169624320:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:0.0:1790391461.816499:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391461.816521:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.816553:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1d25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.816567:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.816593:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.816703:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03f4 expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.816719:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1d25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03f4 expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391461.816727:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:0.0:1790391461.816730:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790391461.816734:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefa00, rc 0) 00000100:00100000:0.0:1790391461.816807:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:11913:x1877361169624320:12345-192.168.202.28@tcp:101:bash.0 Request processed in 331us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391461.816813:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 207 00000100:00100000:1.0:1790391461.822199:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391461.822496:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169624576 00000100:00100000:3.0:1790391461.822507:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169624576 00000100:00100000:3.0:1790391461.822611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 208 00000100:00100000:3.0:1790391461.822622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:11913:x1877361169624576:12345-192.168.202.28@tcp:36:bash.0 00010000:00010000:3.0:1790391461.822963:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.822984:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.822996:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391461.823038:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1790391461.823062:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002a46795 reply state 000000004ec46e39 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.823074:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391461.823081:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:3.0:1790391461.823085:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391461.823089:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790391461.823129:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1790391461.823489:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:11913:x1877361169624576:12345-192.168.202.28@tcp:36:bash.0 Request processed in 864us (1297us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1790391461.823498:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 208 00000020:00080000:3.0:1790391461.823503:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1790391461.832423:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391461.832542:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169624704 00000100:00100000:2.0:1790391461.832554:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169624704 00000100:00100000:2.0:1790391461.832618:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 209 00000100:00100000:2.0:1790391461.832629:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+34:11913:x1877361169624704:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391461.832651:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391461.832671:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1d33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b03fb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.832730:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1d33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03fb expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.832777:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1d33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03fb expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.832797:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:2.0:1790391461.832801:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391461.832804:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c600, rc 0) 00000100:00100000:2.0:1790391461.832902:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:11913:x1877361169624704:12345-192.168.202.28@tcp:101:bash.0 Request processed in 276us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.832909:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 209 00010000:00010000:2.0:1790391461.833391:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391461.835974:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391461.836090:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169624832 00000100:00100000:2.0:1790391461.836101:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169624832 00000100:00100000:2.0:1790391461.836165:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:2.0:1790391461.836175:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:11913:x1877361169624832:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391461.836192:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391461.836213:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080a9de9c/0x2b1b7949f13e1d3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0402 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391461.836238:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6ab734a4, atime: 0x6ab734a3, ctime: 0x6ab734a4, blocks: 0x8 00010000:00010000:2.0:1790391461.836260:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1790391461.836264:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391461.836273:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080a9de9c/0x2b1b7949f13e1d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0402 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.836289:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080a9de9c/0x2b1b7949f13e1d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0402 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.836318:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d800, rc 0) 00000100:00100000:2.0:1790391461.836387:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:11913:x1877361169624832:12345-192.168.202.28@tcp:101:bash.0 Request processed in 214us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.836395:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:3.0:1790391461.846042:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391461.846144:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169624960 00000100:00100000:0.0:1790391461.846155:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169624960 00002000:00010000:0.0:1790391461.846208:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1790391461.846214:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5183b54700 with x1877361169624960 ext(0->18446744073709551615) 00002000:00010000:0.0:1790391461.846225:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5183b54700. 00000100:00100000:0.0:1790391461.846267:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:0.0:1790391461.846278:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169624960:12345-192.168.202.28@tcp:10:bash.0 00002000:00010000:0.0:1790391461.846556:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790391461.846560:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1790391460 -> 1790391462 00002000:00010000:0.0:1790391461.846562:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1790391459 -> 1790391459 00002000:00010000:0.0:1790391461.846564:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1790391460 -> 1790391462 00002000:00010000:0.0:1790391461.846576:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1790391461.846637:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2384:x1877361169624960:12345-192.168.202.28@tcp:10:bash.0 Request processed in 361us (605us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1790391461.846647:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 5 00002000:00010000:0.0:1790391461.846650:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1790391461.846653:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5183b54700 with x1877361169624960 ext(0->18446744073709551615) 00002000:00010000:0.0:1790391461.846657:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5183b54700. 00000100:00100000:3.0:1790391461.948699:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391461.948786:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169625088 00000100:00100000:2.0:1790391461.948797:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169625088 00000100:00100000:2.0:1790391461.948870:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 210 00000100:00100000:2.0:1790391461.950759:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12394:x1877361169625088:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:2.0:1790391461.950844:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.950862:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.950873:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.950910:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.950917:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.950924:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951015:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951044:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951052:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391461.951104:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951116:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951123:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d41 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951130:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951136:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ce00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391461.951140:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951148:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d41 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951159:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391461.951174:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391461.951180:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951187:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951208:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951214:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951289:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951636:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391461.951639:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951646:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951655:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6c500) 00010000:00010000:2.0:1790391461.951658:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391461.951661:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951668:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951684:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951690:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951695:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951708:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391461.951711:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951717:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951725:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:2.0:1790391461.951728:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391461.951731:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391461.951737:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391461.951844:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12394:x1877361169625088:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 2962us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391461.951853:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 210 00000100:00100000:1.0:1790391462.001011:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.001120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169625344 00000100:00100000:2.0:1790391462.001131:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169625344 00000100:00100000:2.0:1790391462.001202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 211 00000100:00100000:2.0:1790391462.001213:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+35:12397:x1877361169625344:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391462.001248:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.001270:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0409 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001354:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d5d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001388:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001400:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001415:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001422:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001427:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001540:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1d6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001550:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1d6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001558:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1d6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391462.001569:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790391462.001664:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001672:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d5d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001678:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001690:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.001695:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001702:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d5d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001717:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391462.001720:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391462.001724:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001730:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001753:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001759:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001765:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001770:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ce00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.001772:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001777:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001795:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6c500) 00010000:00010000:2.0:1790391462.001798:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391462.001801:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001807:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001849:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0409 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001862:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1d6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0409 expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.001869:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:2.0:1790391462.001871:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790391462.001873:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309de00, rc 0) 00000100:00100000:2.0:1790391462.001997:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:12397:x1877361169625344:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 785us (995us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1790391462.002004:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 211 00000100:00100000:3.0:1790391462.005344:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391462.005417:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169625472 00000100:00100000:0.0:1790391462.005428:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169625472 00000100:00100000:0.0:1790391462.005485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 212 00000100:00100000:0.0:1790391462.005496:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:12397:x1877361169625472:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:0.0:1790391462.005571:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.005586:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ed expref: 37 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.005596:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.005647:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ed expref: 37 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.005661:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ed expref: 37 pid: 10091 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391462.005675:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51832a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186461696:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391462.005768:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391462.008108:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51832a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186461696:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391462.008141:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391462.008860:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391462.009028:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169625728 00000100:00100000:1.0:1790391462.009036:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169625728 00000100:00100000:1.0:1790391462.009097:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:1.0:1790391462.009107:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:6156:x1877361169625728:12345-192.168.202.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790391462.009449:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:6156:x1877361169625728:12345-192.168.202.28@tcp:35:ldlm_bl.0 Request processed in 341us (589us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1790391462.009457:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:3.0:1790391462.011647:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.011732:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169625856 00000100:00100000:2.0:1790391462.011751:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169625856 00010000:00010000:2.0:1790391462.011798:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ed expref: 39 pid: 10091 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391462.011840:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 94 00000100:00100000:2.0:1790391462.011851:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:2383:x1877361169625856:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391462.011932:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391462.011940:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ed expref: 39 pid: 10091 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.011954:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ed expref: 39 pid: 10091 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.011977:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c400/0x2b1b7949f13e1d10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03ed expref: 39 pid: 10091 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.011994:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:2.0:1790391462.011999:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.012009:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.012017:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.012043:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391462.012091:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:2383:x1877361169625856:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 241us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.012099:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 94 00010000:00010000:0.0:1790391462.012104:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.012112:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.012153:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.012161:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.012167:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.012173:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391462.012177:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.012184:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.012193:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:0.0:1790391462.012196:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391462.012200:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.012206:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1d79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391462.012310:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:12397:x1877361169625472:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 6815us (6986us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391462.012319:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 212 00000100:00100000:2.0:1790391462.017234:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391462.017487:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169626112 00000100:00100000:1.0:1790391462.017498:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169626112 00000100:00100000:1.0:1790391462.017561:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:1.0:1790391462.017571:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+37:12397:x1877361169626112:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391462.017830:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:12397:x1877361169626112:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 259us (613us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1790391462.017838:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:3.0:1790391462.114255:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.114433:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169626368 00000100:00100000:2.0:1790391462.114444:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169626368 00000100:00100000:2.0:1790391462.114514:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 213 00000100:00100000:2.0:1790391462.114524:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+38:12408:x1877361169626368:12345-192.168.202.28@tcp:101:cat.0 00010000:00010000:2.0:1790391462.114556:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.114577:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0410 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.114650:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d87 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.114664:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d87 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.114675:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d87 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.114691:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.114698:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.114704:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.114846:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1d95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.114854:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1d95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.114861:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1d95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391462.114870:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1790391462.114997:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d87 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115005:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d87 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115011:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115016:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ce00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.115021:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115028:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115039:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391462.115042:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391462.115045:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115050:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1d87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115061:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115067:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115072:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115076:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.115084:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115090:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115098:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6c500) 00010000:00010000:2.0:1790391462.115101:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391462.115104:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d8e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115109:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1d8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115150:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1d80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0410 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115163:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1d95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0410 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.115170:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:2.0:1790391462.115172:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391462.115175:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309cc00, rc 0) 00000100:00100000:2.0:1790391462.115289:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:12408:x1877361169626368:12345-192.168.202.28@tcp:101:cat.0 Request processed in 766us (1044us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790391462.115296:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 213 00000100:00100000:3.0:1790391462.121438:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391462.121954:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169626624 00000100:00100000:1.0:1790391462.121965:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169626624 00000100:00100000:1.0:1790391462.122069:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:1.0:1790391462.122080:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+40:12408:x1877361169626624:12345-192.168.202.28@tcp:35:cat.0 00000100:00100000:1.0:1790391462.122730:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+41:12408:x1877361169626624:12345-192.168.202.28@tcp:35:cat.0 Request processed in 648us (1410us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1790391462.122750:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:0.0:1790391462.144719:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.145058:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169626880 00000100:00100000:2.0:1790391462.145069:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169626880 00000100:00100000:2.0:1790391462.145135:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 214 00000100:00100000:2.0:1790391462.145149:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+41:12409:x1877361169626880:12345-192.168.202.28@tcp:36:rm.0 00010000:00010000:2.0:1790391462.145249:0:10091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1790391462.145278:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c600/0x2b1b7949f13e1d33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03fb expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145315:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309cc00/0x2b1b7949f13e1d95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0410 expref: 40 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145337:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309de00/0x2b1b7949f13e1d6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0409 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145349:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefa00/0x2b1b7949f13e1d25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03f4 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145360:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:2.0:1790391462.145364:0:10091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391462.145387:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1da3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145398:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1da3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145408:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1da3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145422:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145429:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145446:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145530:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1db1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145538:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1db1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145544:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1db1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391462.145784:0:10091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1790391462.145795:0:10091:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375512916855ns, next at 376512913805ns, rc = 0 00010000:00010000:2.0:1790391462.145858:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145867:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145906:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145914:0:10091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145920:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145926:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145962:0:10091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391462.145981:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1db1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145988:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1db1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145993:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1db1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.145999:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ce00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.146004:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1db1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146012:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1db1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146021:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:2.0:1790391462.146024:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790391462.146028:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1db1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146033:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e1db1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146049:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1da3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146054:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1da3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146069:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1da3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146073:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.146076:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1da3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146081:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1da3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146087:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391462.146089:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391462.146092:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1da3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146098:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c200/0x2b1b7949f13e1da3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391462.146106:0:10091:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6a3ebcc reply state 0000000040c7beba transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146115:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.146120:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6c500) 00010000:00010000:2.0:1790391462.146123:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790391462.146125:0:10091:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391462.146211:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:12409:x1877361169626880:12345-192.168.202.28@tcp:36:rm.0 Request processed in 1064us (1500us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790391462.146219:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 214 00010000:00010000:1.0:1790391462.146829:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391462.146837:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.146844:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391462.146847:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.146854:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.146903:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:1.0:1790391462.146906:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790391462.146910:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.146915:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054200/0x2b1b7949f13e1db8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.146928:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391462.146930:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391462.146931:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391462.193674:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.193850:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169627136 00000100:00100000:2.0:1790391462.193861:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169627136 00000100:00100000:2.0:1790391462.193964:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 215 00000100:00100000:2.0:1790391462.193976:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+39:12415:x1877361169627136:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391462.194002:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.194025:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1dbf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0417 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.194135:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e1dc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.194150:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e1dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.194162:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e1dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.194173:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.194181:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.194187:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790391462.195057:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1790391462.195194:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195206:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195600:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195722:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e1dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195730:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e1dc6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195736:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e1dc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195751:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391462.195756:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e1dc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195763:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e1dc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195795:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391462.195798:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391462.195804:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e1dc6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195809:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054000/0x2b1b7949f13e1dc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391462.195826:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f67b8f1 reply state 00000000cc572fde transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195838:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195844:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6c500) 00010000:00010000:0.0:1790391462.195846:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790391462.195849:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790391462.195942:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1dbf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0417 expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195956:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0417 expref: 41 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.195963:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85700) 00010000:00010000:0.0:1790391462.195965:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391462.195967:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefe00, rc 0) 00000100:00100000:0.0:1790391462.196041:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+42:12415:x1877361169627136:12345-192.168.202.28@tcp:101:bash.0 Request processed in 2068us (2376us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1790391462.196050:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 215 00000100:00100000:2.0:1790391462.200172:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391462.200461:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169627264 00000100:00100000:3.0:1790391462.200471:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169627264 00000100:00100000:3.0:1790391462.200572:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:3.0:1790391462.200582:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169627264:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:3.0:1790391462.200599:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391462.200624:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008445c133/0x2b1b7949f13e1de2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b041e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790391462.200648:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391462.200666:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1790391462.200671:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391462.200679:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008445c133/0x2b1b7949f13e1de2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b041e expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.200699:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008445c133/0x2b1b7949f13e1de2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b041e expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.200712:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c200, rc 0) 00000100:00100000:3.0:1790391462.200805:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169627264:12345-192.168.202.28@tcp:101:bash.0 Request processed in 224us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391462.200812:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00080000:2.0:1790391462.202806:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391462.203833:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.203983:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169627392 00000100:00100000:2.0:1790391462.203992:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169627392 00000100:00100000:2.0:1790391462.204111:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:2.0:1790391462.204139:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:12415:x1877361169627392:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391462.204159:0:10505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.204176:0:10505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0425 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.204205:0:10505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008445c133/0x2b1b7949f13e1de2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b041e expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.204227:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391462.204231:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391462.204236:0:10505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 9 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.204271:0:10505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008445c133/0x2b1b7949f13e1de2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b041e expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.204285:0:10505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008445c133/0x2b1b7949f13e1de2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b041e expref: 9 pid: 8429 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391462.204801:0:10505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10505:1877361186461824:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391462.204946:0:10505:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391462.208541:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391462.208908:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169627520 00000100:00100000:1.0:1790391462.208918:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169627520 00010000:00010000:1.0:1790391462.208958:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008445c133/0x2b1b7949f13e1de2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b041e expref: 10 pid: 8429 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391462.208993:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 95 00000100:00100000:1.0:1790391462.209001:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:2384:x1877361169627520:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391462.209015:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391462.209034:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008445c133/0x2b1b7949f13e1de2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b041e expref: 10 pid: 8429 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.209047:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008445c133/0x2b1b7949f13e1de2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b041e expref: 10 pid: 8429 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.209070:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391462.209085:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391462.209094:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 10 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.209104:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 10 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.209148:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 10 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391462.209162:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6499:1877361186461952:192.168.202.28@tcp:105: 00000100:00100000:1.0:1790391462.209255:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76850c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790391462.211948:0:10505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008445c133/0x2b1b7949f13e1de2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b041e expref: 10 pid: 8429 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391462.211974:0:10505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10505:1877361186461824:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391462.212026:0:10505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 9 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.212042:0:10505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055400, rc 0) 00000100:00100000:3.0:1790391462.212266:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:12415:x1877361169627392:12345-192.168.202.28@tcp:101:bash.0 Request processed in 8129us (8440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391462.212277:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:2.0:1790391462.213623:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6499:1877361186461952:192.168.202.28@tcp:105: 00010000:00010000:2.0:1790391462.213645:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391462.213696:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169627520:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 4694us (5163us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.213721:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 95 00000100:00100000:1.0:1790391462.217726:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391462.217825:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169627776 00000100:00100000:3.0:1790391462.217836:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169627776 00000100:00100000:3.0:1790391462.217923:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:3.0:1790391462.217935:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+42:12415:x1877361169627776:12345-192.168.202.28@tcp:35:bash.0 00000100:00100000:3.0:1790391462.218235:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+43:12415:x1877361169627776:12345-192.168.202.28@tcp:35:bash.0 Request processed in 302us (522us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1790391462.218243:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:0.0:1790391462.352328:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.352438:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169627904 00000100:00100000:2.0:1790391462.352449:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169627904 00000100:00100000:2.0:1790391462.352525:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 216 00000100:00100000:2.0:1790391462.352538:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51832a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+43:12432:x1877361169627904:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391462.352561:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.352583:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054a00/0x2b1b7949f13e1df0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b042c expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.352668:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1df7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.352682:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1df7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.352694:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1df7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391462.352770:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790391462.352774:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391462.352794:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1df7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.352819:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054a00/0x2b1b7949f13e1df0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b042c expref: 45 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.352839:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1df7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b042c expref: 44 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.352863:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391462.352866:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391462.352870:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055800, rc 0) 00000100:00100000:2.0:1790391462.353119:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51832a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+44:12432:x1877361169627904:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 583us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.353126:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 216 00000100:00100000:0.0:1790391462.361270:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391462.362089:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169628160 00000100:00100000:1.0:1790391462.362103:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169628160 00000100:00100000:1.0:1790391462.362179:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 217 00000100:00100000:1.0:1790391462.362192:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+44:12432:x1877361169628160:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391462.362217:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391462.362243:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1dfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0433 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.362368:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1e05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.362384:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1e05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.362396:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1e05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391462.362422:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790391462.362730:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1dfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0433 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.362760:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1e05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0433 expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.362768:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85700) 00010000:00010000:1.0:1790391462.362771:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391462.362775:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087000, rc 0) 00000100:00100000:1.0:1790391462.363012:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+46:12432:x1877361169628160:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 822us (1752us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1790391462.363020:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 217 00000100:00100000:1.0:1790391462.372817:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391462.372866:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.372992:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169628544 00000100:00100000:2.0:1790391462.373004:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169628544 00000100:00100000:2.0:1790391462.373083:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:2.0:1790391462.373096:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+46:2383:x1877361169628544:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391462.373113:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391462.373140:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1e05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0433 expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.373160:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85700) 00010000:00010000:2.0:1790391462.373168:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391462.373241:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+45:2383:x1877361169628544:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 149us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.373250:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:0.0:1790391462.373586:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169628416 00000100:00100000:0.0:1790391462.373592:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169628416 00000100:00100000:0.0:1790391462.373630:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 218 00000100:00100000:0.0:1790391462.373639:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+45:12432:x1877361169628416:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391462.373660:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391462.373677:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1e13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b043a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.373835:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.373849:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.373860:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391462.373872:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790391462.374003:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef800/0x2b1b7949f13e1e13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b043a expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.374019:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b043a expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.374027:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85700) 00010000:00010000:0.0:1790391462.374029:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790391462.374040:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eeee00, rc 0) 00000100:00100000:0.0:1790391462.374072:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+47:12432:x1877361169628416:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 435us (1277us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1790391462.374079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 218 00000100:00100000:0.0:1790391462.389022:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391462.389127:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169628672 00000100:00100000:1.0:1790391462.389138:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169628672 00000100:00100000:1.0:1790391462.389211:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 69 00000100:00100000:1.0:1790391462.389229:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169628672:12345-192.168.202.28@tcp:1:lfs.0 00010000:00010000:1.0:1790391462.389276:0:9796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.389298:0:9796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 8 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.389307:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391462.389336:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391462.389342:0:9796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.389380:0:9796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 8 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.389394:0:9796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 8 pid: 10505 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391462.389409:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9796:1877361186462080:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391462.389522:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391462.397420:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391462.397545:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169628800 00000100:00100000:0.0:1790391462.397555:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169628800 00002000:00100000:0.0:1790391462.397603:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9e5183292a00 x1877361169628800/t0(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:328/0 lens 504/0 e 0 to 0 dl 1790391473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790391462.397614:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5183292a00 with x1877361169628800 ext(0->8) 00010000:00010000:0.0:1790391462.397624:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 9 pid: 10505 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.397640:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 9 pid: 10505 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391462.397648:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5183292a00 00000100:00100000:0.0:1790391462.397684:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:0.0:1790391462.397694:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2383:x1877361169628800:12345-192.168.202.28@tcp:4:lfs.0 00000100:00100000:1.0:1790391462.398953:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9796:1877361186462080:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391462.398990:0:9796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391462.401803:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:2383:x1877361169628800:12345-192.168.202.28@tcp:4:lfs.0 Request processed in 4097us (4383us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790391462.401820:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 3 00002000:00100000:2.0:1790391462.401834:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9e5183292a00 x1877361169628800/t4294967309(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:328/0 lens 504/448 e 0 to 0 dl 1790391473 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790391462.401861:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5183292a00 with x1877361169628800 ext(0->8) 00010000:00010000:2.0:1790391462.401872:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 11 pid: 10505 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.401914:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 11 pid: 10505 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391462.401920:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e5183292a00 00000100:00100000:0.0:1790391462.412260:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391462.412447:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169628928 00000100:00100000:3.0:1790391462.412457:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169628928 00010000:00010000:3.0:1790391462.412499:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 11 pid: 10505 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391462.412554:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 96 00000100:00100000:3.0:1790391462.412565:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:2382:x1877361169628928:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391462.412581:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790391462.412600:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790391462.412604:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790391462 00002000:00010000:3.0:1790391462.412606:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790391462 00002000:00010000:3.0:1790391462.412621:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1790391462 00002000:00010000:3.0:1790391462.412623:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1790391462.412631:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 11 pid: 10505 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412645:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 11 pid: 10505 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412668:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e1de9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0425 expref: 11 pid: 10505 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412689:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391462.412693:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391462.412700:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412710:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412752:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391462.412807:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:2382:x1877361169628928:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 243us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391462.412815:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 96 00010000:00010000:3.0:1790391462.412844:0:9796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412854:0:9796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412934:0:9796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412945:0:9796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412954:0:9796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412961:0:9796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391462.412965:0:9796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412975:0:9796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412986:0:9796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.412993:0:9796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001e79715/0x2b1b7949f13e1e28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391462.413055:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2384:x1877361169628672:12345-192.168.202.28@tcp:1:lfs.0 Request processed in 23829us (24044us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391462.413063:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 69 00000100:00100000:0.0:1790391462.421623:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391462.421765:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169629184 00000100:00100000:3.0:1790391462.421777:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169629184 00000100:00100000:3.0:1790391462.421838:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:3.0:1790391462.421849:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+47:12432:x1877361169629184:12345-192.168.202.28@tcp:35:lfs.0 00000004:00010000:3.0:1790391462.421932:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b043a expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391462.422134:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1790391462.422164:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1790391462.422840:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1790391462.422919:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.422936:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0417 expref: 51 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.422945:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.422982:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0417 expref: 51 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.422995:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0417 expref: 51 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391462.423010:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183291c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1877361186462208:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391462.423092:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391462.427711:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183291c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1877361186462208:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391462.427753:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391462.428062:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.428129:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169629312 00000100:00100000:2.0:1790391462.428137:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169629312 00010000:00010000:2.0:1790391462.428195:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0417 expref: 52 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391462.428239:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 97 00000100:00100000:2.0:1790391462.428249:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+52:2384:x1877361169629312:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391462.428265:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391462.428271:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0417 expref: 52 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.428285:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0417 expref: 52 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.428321:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1dd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0417 expref: 52 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.428338:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85700) 00010000:00010000:2.0:1790391462.428359:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.428370:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.428379:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.428414:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391462.428468:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+51:2384:x1877361169629312:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 220us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.428476:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 97 00010000:00010000:3.0:1790391462.428659:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.428676:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391462.428809:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1790391462.428980:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1790391462.429078:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183290380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877361186462336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790391462.429135:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391462.429162:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727480 going to sleep for 11 seconds 00000100:00100000:2.0:1790391462.429456:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186462336 00000100:00100000:2.0:1790391462.429463:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186462336 00000100:00100000:2.0:1790391462.429748:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790391462.429760:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6515:x1877361186462336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790391462.429853:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6515:x1877361186462336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.429861:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790391462.429921:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183290380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877361186462336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790391462.430043:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1790391462.430099:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b0a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877361186462464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790391462.430130:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391462.430148:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823a1780 going to sleep for 11 seconds 00000100:00080000:3.0:1790391462.430219:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391462.430323:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186462464 00000100:00100000:1.0:1790391462.430328:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186462464 00000100:00100000:1.0:1790391462.430362:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1790391462.430369:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6515:x1877361186462464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790391462.430483:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6515:x1877361186462464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 114us (352us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790391462.430517:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790391462.431960:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b0a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1877361186462464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790391462.432033:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1790391462.432084:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.432094:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.432102:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.432108:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391462.432112:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.432120:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.432135:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85700) 00010000:00010000:3.0:1790391462.432138:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790391462.432156:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.432175:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391462.432289:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790391462.432933:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1790391462.432949:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375800071402ns, next at 376800067739ns, rc = 0 00000001:00080000:3.0:1790391462.432958:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1790391462.432993:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85700) 00010000:00010000:3.0:1790391462.432997:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790391462.433007:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b043a expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391462.433138:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+54:12432:x1877361169629184:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 11289us (11524us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1790391462.433149:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 56 00000020:00080000:3.0:1790391462.433155:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790391462.438291:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391462.438433:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169629440 00000100:00100000:0.0:1790391462.438443:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169629440 00000100:00100000:0.0:1790391462.438518:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 219 00000100:00100000:0.0:1790391462.438529:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+54:12432:x1877361169629440:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391462.438553:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391462.438592:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1e36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0441 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.438656:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1e36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0441 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.438672:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1e36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0441 expref: 55 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.438692:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:0.0:1790391462.438695:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391462.438699:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef400, rc 0) 00000100:00100000:0.0:1790391462.438772:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+55:12432:x1877361169629440:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 244us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391462.438780:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 219 00000100:00100000:1.0:1790391462.449850:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391462.450639:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169629696 00000100:00100000:0.0:1790391462.450651:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169629696 00000100:00100000:0.0:1790391462.450733:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:0.0:1790391462.450753:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+55:12432:x1877361169629696:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:0.0:1790391462.451029:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+56:12432:x1877361169629696:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 276us (1189us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1790391462.451037:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:2.0:1790391462.560771:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391462.561914:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169629824 00000100:00100000:0.0:1790391462.561927:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169629824 00000100:00100000:2.0:1790391462.562128:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 220 00000100:00100000:2.0:1790391462.562153:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+56:12443:x1877361169629824:12345-192.168.202.28@tcp:34:lfs.0 00010000:00010000:2.0:1790391462.562250:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e3d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562269:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562281:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562294:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562302:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562310:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562384:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562393:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562400:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391462.562447:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562460:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562472:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e3d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562479:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562485:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.562490:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562498:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e3d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562510:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391462.562513:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391462.562518:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562524:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562540:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562545:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562551:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562556:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.562565:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562572:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562580:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6c500) 00010000:00010000:2.0:1790391462.562582:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391462.562584:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562589:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562599:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562604:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562609:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562613:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.562616:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562622:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562628:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391462.562630:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391462.562640:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.562646:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1e4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391462.562729:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+56:12443:x1877361169629824:12345-192.168.202.28@tcp:34:lfs.0 Request processed in 578us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.562744:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 220 00000100:00100000:2.0:1790391462.604679:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391462.604799:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169630080 00000100:00100000:0.0:1790391462.604808:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169630080 00000100:00100000:0.0:1790391462.604856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 221 00000100:00100000:0.0:1790391462.604864:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+56:12446:x1877361169630080:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391462.604924:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391462.604943:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1e52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0448 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605006:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1e59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605017:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605025:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605033:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605037:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605041:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605129:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605134:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605138:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391462.605144:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790391462.605235:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605243:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1e59 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605249:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1e59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605255:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391462.605259:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1e59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605268:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1e59 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605279:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391462.605281:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391462.605285:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1e59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605289:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefc00/0x2b1b7949f13e1e59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605301:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605307:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605314:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605319:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eeee00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391462.605328:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605335:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605344:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6c500) 00010000:00010000:0.0:1790391462.605346:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391462.605349:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605355:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e1e60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605390:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e1e52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0448 expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605404:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0448 expref: 58 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391462.605411:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:0.0:1790391462.605414:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391462.605417:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefe00, rc 0) 00000100:00100000:0.0:1790391462.605463:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+58:12446:x1877361169630080:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 599us (797us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1790391462.605468:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 221 00000100:00100000:1.0:1790391462.616984:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391462.617052:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169630208 00000100:00100000:3.0:1790391462.617061:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169630208 00000100:00100000:3.0:1790391462.617153:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 222 00000100:00100000:3.0:1790391462.617161:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+58:12446:x1877361169630208:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:3.0:1790391462.617242:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.617260:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.617272:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.617321:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.617329:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.617336:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.617341:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391462.617346:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.617354:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.617367:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:3.0:1790391462.617370:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391462.617375:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.617381:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1e75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391462.617468:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+58:12446:x1877361169630208:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 307us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391462.617476:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 222 00000100:00100000:2.0:1790391462.622179:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391462.622441:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169630464 00000100:00100000:1.0:1790391462.622452:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169630464 00000100:00100000:1.0:1790391462.622613:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00100000:1.0:1790391462.622624:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+58:12446:x1877361169630464:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391462.622907:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:12446:x1877361169630464:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 283us (749us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1790391462.622916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00100000:0.0:1790391462.714971:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.715068:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169630720 00000100:00100000:2.0:1790391462.715078:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169630720 00000100:00100000:2.0:1790391462.715147:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 223 00000100:00100000:2.0:1790391462.715160:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:12456:x1877361169630720:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391462.715185:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.715189:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790391462.715217:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1df7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b042c expref: 59 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.715237:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391462.715242:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391462.715256:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e7c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b044f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.715377:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.715392:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0448 expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.715414:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.715448:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0448 expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.715461:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0448 expref: 59 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391462.715475:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186462592:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391462.715575:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae89e300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391462.721347:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186462592:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391462.721389:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391462.722564:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391462.722986:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169630848 00000100:00100000:3.0:1790391462.722996:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169630848 00010000:00010000:3.0:1790391462.723037:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0448 expref: 60 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391462.723097:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 98 00000100:00100000:3.0:1790391462.723107:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:2384:x1877361169630848:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391462.723123:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391462.723132:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0448 expref: 60 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.723145:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0448 expref: 60 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.723167:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eefe00/0x2b1b7949f13e1e67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0448 expref: 60 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.723183:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:3.0:1790391462.723189:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.723199:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.723207:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391462.723243:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391462.723454:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.723463:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391462.723482:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790391462.723636:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1e7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b044f expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.723653:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b044f expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.723660:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:1.0:1790391462.723663:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790391462.723666:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054800, rc 0) 00000100:00100000:1.0:1790391462.723694:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:12456:x1877361169630720:12345-192.168.202.28@tcp:101:bash.0 Request processed in 8537us (8734us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1790391462.723710:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 223 00000100:00100000:3.0:1790391462.724534:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:2384:x1877361169630848:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 208us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391462.724544:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 98 00000100:00100000:3.0:1790391462.727759:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.728100:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169630976 00000100:00100000:2.0:1790391462.728114:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169630976 00000100:00100000:2.0:1790391462.728176:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 224 00000100:00100000:2.0:1790391462.728186:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+59:12456:x1877361169630976:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391462.728220:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.728244:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1e91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0456 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.728282:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.728296:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.728325:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.728435:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1e91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0456 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.728452:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0456 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.728462:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391462.728465:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391462.728469:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055000, rc 0) 00000100:00100000:2.0:1790391462.728533:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:12456:x1877361169630976:12345-192.168.202.28@tcp:101:bash.0 Request processed in 349us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.728540:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 224 00000100:00100000:1.0:1790391462.733518:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.733614:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169631232 00000100:00100000:2.0:1790391462.733630:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169631232 00000100:00100000:2.0:1790391462.733697:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 225 00000100:00100000:2.0:1790391462.733708:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+60:12456:x1877361169631232:12345-192.168.202.28@tcp:36:bash.0 00010000:00010000:2.0:1790391462.733994:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.734015:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.734028:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391462.734087:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1790391462.734113:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b70b21bb reply state 000000003075bfba transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.734129:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.734139:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391462.734142:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790391462.734147:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391462.734241:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+63:12456:x1877361169631232:12345-192.168.202.28@tcp:36:bash.0 Request processed in 535us (733us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1790391462.734249:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 225 00000020:00080000:2.0:1790391462.734253:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790391462.738156:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.738254:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169631360 00000100:00100000:2.0:1790391462.738264:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169631360 00000100:00100000:2.0:1790391462.738338:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 226 00000100:00100000:2.0:1790391462.738349:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+63:12456:x1877361169631360:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:2.0:1790391462.738372:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.738393:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1ea6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b045d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.738506:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.738521:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b044f expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.738541:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.738576:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b044f expref: 64 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.738589:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b044f expref: 64 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391462.738602:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186462720:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391462.739006:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0b41e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391462.742516:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391462.742664:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169631488 00000100:00100000:1.0:1790391462.742674:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169631488 00010000:00010000:1.0:1790391462.742719:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b044f expref: 65 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391462.742774:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 99 00000100:00100000:1.0:1790391462.742791:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:2384:x1877361169631488:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391462.742806:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391462.742812:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b044f expref: 65 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.742826:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b044f expref: 65 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.742847:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:1.0:1790391462.742851:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.742861:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.742870:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.742924:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391462.742975:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:2384:x1877361169631488:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 192us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391462.742994:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 99 00010000:00010000:2.0:1790391462.744362:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1e83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b044f expref: 64 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391462.744384:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186462720:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391462.744410:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.744419:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.744424:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391462.744479:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790391462.744484:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391462.744503:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.744548:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1ea6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b045d expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.744563:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b045d expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.744573:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391462.744576:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391462.744579:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054e00, rc 0) 00000100:00100000:2.0:1790391462.744804:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+63:12456:x1877361169631360:12345-192.168.202.28@tcp:101:bash.0 Request processed in 6456us (6658us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.744813:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 226 00000100:00100000:3.0:1790391462.748656:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.748873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169631744 00000100:00100000:2.0:1790391462.748923:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169631744 00000100:00100000:2.0:1790391462.748987:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:2.0:1790391462.748998:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+63:12456:x1877361169631744:12345-192.168.202.28@tcp:35:bash.0 00000100:00100000:2.0:1790391462.749239:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+64:12456:x1877361169631744:12345-192.168.202.28@tcp:35:bash.0 Request processed in 242us (592us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1790391462.749247:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:1.0:1790391462.838058:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.838340:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169631872 00000100:00100000:2.0:1790391462.838352:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169631872 00000100:00100000:2.0:1790391462.838416:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 227 00000100:00100000:2.0:1790391462.838428:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+64:12462:x1877361169631872:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391462.838454:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.838476:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1eb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0464 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.838551:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1ebb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.838566:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.838578:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391462.838926:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790391462.838931:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391462.838954:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.838978:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1eb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0464 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.838996:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1ebb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0464 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.839004:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391462.839007:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391462.839011:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054800, rc 0) 00000100:00100000:2.0:1790391462.839076:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51822a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:12462:x1877361169631872:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 650us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.839083:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 227 00000100:00100000:3.0:1790391462.843049:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.843156:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169632000 00000100:00100000:2.0:1790391462.843166:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169632000 00000100:00100000:2.0:1790391462.843251:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 228 00000100:00100000:2.0:1790391462.843263:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:12462:x1877361169632000:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391462.843286:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.843307:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1ec2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b046b expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.843385:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1ec9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.843400:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.843412:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.843424:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1ed0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.843431:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.843437:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.843509:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ed7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.843517:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.843524:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391462.843575:0:10091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790391462.843580:0:10091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391462.843598:0:10091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844393:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844405:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844412:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1ec9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844419:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844425:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.844430:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844438:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1ec9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844451:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391462.844454:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391462.844459:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1ec9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844466:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1ec9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844492:0:10091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844497:0:10091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1ed0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844502:0:10091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844507:0:10091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391462.844510:0:10091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844516:0:10091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844523:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6c500) 00010000:00010000:2.0:1790391462.844525:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391462.844528:0:10091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1ed0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844534:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1ed0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844562:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1ec2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b046b expref: 67 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844576:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b046b expref: 66 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.844595:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391462.844598:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391462.844600:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055e00, rc 0) 00000100:00100000:2.0:1790391462.845138:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:12462:x1877361169632000:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 1874us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.845147:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 228 00000100:00100000:3.0:1790391462.849426:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391462.849524:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.849612:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169632384 00000100:00100000:2.0:1790391462.849622:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169632384 00000100:00100000:2.0:1790391462.849703:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:2.0:1790391462.849713:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:2384:x1877361169632384:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391462.849742:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391462.849767:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ed7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b046b expref: 66 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.849798:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391462.849804:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391462.849858:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:2384:x1877361169632384:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 146us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.849865:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:1.0:1790391462.853518:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169632256 00000100:00100000:1.0:1790391462.853539:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169632256 00000100:00100000:1.0:1790391462.853721:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 229 00000100:00100000:1.0:1790391462.853744:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a763d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:12462:x1877361169632256:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391462.853773:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391462.853808:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1ede lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0472 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.853951:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.853967:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b045d expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.853976:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.854011:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b045d expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.854024:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b045d expref: 66 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391462.854039:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186462848:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391462.854175:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685a80 going to sleep for 11 seconds 00010000:00010000:1.0:1790391462.857461:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391462.860028:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186462848:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391462.860073:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391462.861233:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391462.861398:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169632512 00000100:00100000:1.0:1790391462.861408:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169632512 00010000:00010000:1.0:1790391462.861450:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b045d expref: 67 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391462.861495:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 100 00000100:00100000:1.0:1790391462.861506:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:2383:x1877361169632512:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391462.861524:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391462.861530:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b045d expref: 67 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.861543:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b045d expref: 67 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.861567:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054e00/0x2b1b7949f13e1ead lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b045d expref: 67 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.861587:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:1.0:1790391462.861592:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.861612:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.861645:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391462.861683:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391462.861751:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:2383:x1877361169632512:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 246us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391462.861758:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 100 00010000:00010000:2.0:1790391462.862165:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.862175:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391462.862196:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790391462.862342:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e1ede lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0472 expref: 67 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.862358:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0472 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.862366:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391462.862369:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790391462.862372:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086e00, rc 0) 00000100:00100000:2.0:1790391462.862419:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a763d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:12462:x1877361169632256:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 8688us (13003us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1790391462.862426:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 229 00000100:00100000:3.0:1790391462.872996:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.873274:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169632768 00000100:00100000:2.0:1790391462.873284:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169632768 00000100:00100000:2.0:1790391462.873382:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:2.0:1790391462.873394:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:12462:x1877361169632768:12345-192.168.202.28@tcp:103:lfs.0 00010000:00010000:2.0:1790391462.873411:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391462.873438:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef400/0x2b1b7949f13e1e36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0441 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.873461:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391462.873468:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391462.873582:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:12462:x1877361169632768:12345-192.168.202.28@tcp:103:lfs.0 Request processed in 189us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.873590:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:3.0:1790391462.878915:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.879238:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169632896 00000100:00100000:2.0:1790391462.879248:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169632896 00000100:00100000:2.0:1790391462.879333:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 230 00000100:00100000:2.0:1790391462.879344:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:12462:x1877361169632896:12345-192.168.202.28@tcp:58:lfs.0 00010000:00010000:2.0:1790391462.879452:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.879471:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.879484:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391462.879585:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1790391462.879686:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:12462:x1877361169632896:12345-192.168.202.28@tcp:58:lfs.0 Request processed in 343us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.879694:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 230 00000100:00100000:0.0:1790391462.886348:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391462.886634:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169633024 00000100:00100000:2.0:1790391462.886644:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169633024 00000100:00100000:2.0:1790391462.886713:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 231 00000100:00100000:2.0:1790391462.886725:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+65:12462:x1877361169633024:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391462.886756:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391462.886789:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1efa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0479 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.886846:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.886858:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1efa lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0479 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.886932:0:6512:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.886948:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1efa lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0479 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.886962:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391462.886965:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391462.886969:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1efa lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0479 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391462.886977:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055200, rc 0) 00000100:00100000:2.0:1790391462.887043:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:12462:x1877361169633024:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 320us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391462.887051:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 231 00000100:00100000:2.0:1790391462.924349:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391462.924375:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186462976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391462.924455:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391462.924563:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186462976 00000100:00100000:1.0:1790391462.924571:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186462976 00000100:00100000:1.0:1790391462.924623:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1790391462.924633:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186462976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391462.924667:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1790391462.924725:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186462976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391462.924760:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790391462.924922:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186462976:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1790391463.112688:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391463.112698:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391463.112726:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1790391463.112745:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391463.112921:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186463104:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391463.114515:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76850c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391463.127675:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.127802:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169633152 00000100:00100000:2.0:1790391463.127812:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169633152 00000100:00100000:2.0:1790391463.127935:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 232 00000100:00100000:2.0:1790391463.127946:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:12463:x1877361169633152:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790391463.127980:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790391463.128099:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:12463:x1877361169633152:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 155us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.128122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 232 00000100:00080000:3.0:1790391463.128833:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391463.134099:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.134325:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186463104:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790391463.136368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169633280 00000100:00100000:2.0:1790391463.136384:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169633280 00000100:00100000:2.0:1790391463.136501:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 233 00000100:00100000:2.0:1790391463.136514:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:12463:x1877361169633280:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790391463.136601:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1f01 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136618:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1f01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136630:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1f01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136645:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f08 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136652:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136657:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136679:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136686:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136692:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391463.136765:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790391463.136770:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391463.136783:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136795:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1f01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136802:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1f01 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136808:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1f01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136814:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391463.136818:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1f01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136825:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1f01 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136837:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:2.0:1790391463.136840:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391463.136844:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1f01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136850:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054600/0x2b1b7949f13e1f01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136865:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136899:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f08 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136917:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136921:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391463.136924:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136930:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f08 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136938:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9e52b9b6ce00) 00010000:00010000:2.0:1790391463.136940:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391463.136943:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f08 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136948:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f08 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136964:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136969:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136974:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.136978:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391463.136995:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.137003:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.137011:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391463.137014:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391463.137017:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.137023:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391463.137175:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:12463:x1877361169633280:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 Request processed in 663us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.137183:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 233 00000100:00100000:3.0:1790391463.140299:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.140510:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169633536 00000100:00100000:2.0:1790391463.140519:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169633536 00000100:00100000:2.0:1790391463.140569:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 234 00000100:00100000:2.0:1790391463.140580:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+66:12463:x1877361169633536:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391463.140600:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391463.140620:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054a00/0x2b1b7949f13e1f16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0480 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140714:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140727:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140761:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391463.140771:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790391463.140846:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140851:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140855:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140859:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391463.140862:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140866:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140874:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391463.140893:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790391463.140897:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140901:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140943:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054a00/0x2b1b7949f13e1f16 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0480 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140965:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:2.0:1790391463.140968:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790391463.140973:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054a00/0x2b1b7949f13e1f16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0480 expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.140984:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054a00, rc 0) 00000100:00100000:2.0:1790391463.141048:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:12463:x1877361169633536:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 469us (760us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1790391463.141055:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 234 00000100:00100000:0.0:1790391463.147441:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.147707:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169633664 00000100:00100000:1.0:1790391463.147719:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169633664 00000100:00100000:1.0:1790391463.147812:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 235 00000100:00100000:1.0:1790391463.147824:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:12463:x1877361169633664:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790391463.147909:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790391463.148032:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:12463:x1877361169633664:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 210us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391463.148040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 235 00000100:00100000:0.0:1790391463.152807:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391463.153004:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169633920 00000100:00100000:3.0:1790391463.153014:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169633920 00000100:00100000:3.0:1790391463.153078:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 236 00000100:00100000:3.0:1790391463.153089:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:12463:x1877361169633920:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391463.153111:0:10091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391463.153115:0:10091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790391463.153149:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054800/0x2b1b7949f13e1ebb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0464 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.153170:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:3.0:1790391463.153175:0:10091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391463.153190:0:10091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f2b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0487 expref: -99 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790391463.153772:0:10091:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:3.0:1790391463.154004:0:10091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1f32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.154019:0:10091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1f32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.154045:0:10091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1f32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.154108:0:10091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0487 expref: 69 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.154124:0:10091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1f32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0487 expref: 68 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.154133:0:10091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e51821bae00) 00010000:00010000:3.0:1790391463.154136:0:10091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391463.154139:0:10091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c200, rc 0) 00000100:00100000:3.0:1790391463.154222:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+68:12463:x1877361169633920:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 1134us (1439us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1790391463.154230:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 236 00000100:00100000:3.0:1790391463.161633:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.162194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169634176 00000100:00100000:1.0:1790391463.162207:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169634176 00000100:00100000:1.0:1790391463.162277:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 237 00000100:00100000:1.0:1790391463.162290:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+68:12463:x1877361169634176:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790391463.162371:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391463.162405:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c200/0x2b1b7949f13e1f32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0487 expref: 68 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162424:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e51821bae00) 00010000:00010000:1.0:1790391463.162449:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391463.162470:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1f40 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162484:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1f40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162493:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1f40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162571:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xa12dc35e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162579:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa12dc35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162605:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa12dc35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162664:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1f40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162672:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1f40 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162679:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1f40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162685:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391463.162689:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1f40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162697:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1f40 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162705:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:1.0:1790391463.162708:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391463.162713:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1f40 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162718:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1f40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162738:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa12dc35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162745:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f47 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa12dc35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162757:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa12dc35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162763:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391463.162766:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa12dc35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162772:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f47 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa12dc35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162791:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xa12dc35e (ffff9e5283a48300) 00010000:00010000:1.0:1790391463.162794:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391463.162798:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f47 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa12dc35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.162803:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f47 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa12dc35e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391463.162913:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:12463:x1877361169634176:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 621us (1287us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391463.162921:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 237 00000100:00100000:1.0:1790391463.166495:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.166657:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169634304 00000100:00100000:2.0:1790391463.166668:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169634304 00000100:00100000:2.0:1790391463.166751:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 238 00000100:00100000:2.0:1790391463.166762:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+67:12463:x1877361169634304:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391463.166793:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391463.166817:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054a00/0x2b1b7949f13e1f4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b048e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.166855:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.166869:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.166927:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.167048:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054a00/0x2b1b7949f13e1f4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b048e expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.167077:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b048e expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.167085:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:2.0:1790391463.167089:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391463.167092:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055400, rc 0) 00000100:00100000:2.0:1790391463.167160:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+68:12463:x1877361169634304:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 401us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.167168:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 238 00000100:00100000:0.0:1790391463.171515:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.171669:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169634560 00000100:00100000:1.0:1790391463.171679:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169634560 00000100:00100000:1.0:1790391463.171750:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 239 00000100:00100000:1.0:1790391463.171760:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+68:12463:x1877361169634560:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790391463.171860:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.171937:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.171950:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790391463.172119:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1790391463.172129:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376539251496ns, next at 377539248346ns, rc = 0 00000004:00010000:1.0:1790391463.172183:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b39f82a7 reply state 0000000047f3472d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.172196:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.172204:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:1.0:1790391463.172208:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790391463.172211:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391463.172305:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+70:12463:x1877361169634560:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 546us (811us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1790391463.172313:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 239 00000100:00100000:0.0:1790391463.176106:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.176184:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169634688 00000100:00100000:2.0:1790391463.176196:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169634688 00000100:00100000:2.0:1790391463.176266:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 240 00000100:00100000:2.0:1790391463.176276:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+70:12463:x1877361169634688:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391463.176299:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391463.176332:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0495 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.176394:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0495 expref: 71 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.176407:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0495 expref: 71 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.176426:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:2.0:1790391463.176429:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391463.176447:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055800, rc 0) 00000100:00100000:2.0:1790391463.176518:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+71:12463:x1877361169634688:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 244us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.176525:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 240 00000100:00100000:0.0:1790391463.180725:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.181003:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169634816 00000100:00100000:1.0:1790391463.181013:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169634816 00000100:00100000:1.0:1790391463.181098:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 70 00000100:00100000:1.0:1790391463.181108:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2384:x1877361169634816:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790391463.181331:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:2384:x1877361169634816:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 223us (618us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1790391463.181339:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 70 00000100:00080000:3.0:1790391463.182060:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391463.187908:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.188005:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169635072 00000100:00100000:2.0:1790391463.188014:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169635072 00000100:00100000:2.0:1790391463.188076:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:2.0:1790391463.188087:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+71:12463:x1877361169635072:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790391463.188336:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+72:12463:x1877361169635072:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 250us (468us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1790391463.188345:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:0.0:1790391463.197407:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.197613:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169635328 00000100:00100000:1.0:1790391463.197639:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169635328 00000100:00100000:1.0:1790391463.197704:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 241 00000100:00100000:1.0:1790391463.197714:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+72:12463:x1877361169635328:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790391463.197935:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+72:12463:x1877361169635328:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 221us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391463.197943:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 241 00000100:00100000:0.0:1790391463.200662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.200767:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169635456 00000100:00100000:2.0:1790391463.200776:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169635456 00000100:00100000:2.0:1790391463.200922:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 242 00000100:00100000:2.0:1790391463.200933:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+72:12463:x1877361169635456:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391463.200954:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391463.200973:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054a00/0x2b1b7949f13e1f6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b049c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.201040:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.201053:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.201064:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391463.201130:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391463.201151:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.201177:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054a00/0x2b1b7949f13e1f6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b049c expref: 74 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.201196:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b049c expref: 73 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.201205:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:2.0:1790391463.201208:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790391463.201211:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054c00, rc 0) 00000100:00100000:2.0:1790391463.201263:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+73:12463:x1877361169635456:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 333us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.201270:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 242 00000100:00100000:0.0:1790391463.211011:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391463.211110:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169635584 00000100:00100000:3.0:1790391463.211122:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169635584 00000100:00100000:3.0:1790391463.211192:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 71 00000100:00100000:3.0:1790391463.211212:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+10:2383:x1877361169635584:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391463.211233:0:10505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391463.211257:0:10505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f78 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b04a3 expref: -99 pid: 10505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790391463.211285:0:10505:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab734a7, blocks: 0x0 00010000:00010000:3.0:1790391463.211329:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1790391463.211335:0:10505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391463.211346:0:10505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04a3 expref: 11 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.211366:0:10505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04a3 expref: 11 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.211382:0:10505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d600, rc 0) 00000100:00100000:3.0:1790391463.211448:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:2383:x1877361169635584:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 246us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391463.211455:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 71 00000100:00100000:1.0:1790391463.216393:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.216492:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169635840 00000100:00100000:2.0:1790391463.216512:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169635840 00000100:00100000:2.0:1790391463.216582:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 243 00000100:00100000:2.0:1790391463.216593:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+73:12463:x1877361169635840:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790391463.216712:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+73:12463:x1877361169635840:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 120us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.216720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 243 00000100:00100000:0.0:1790391463.220242:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391463.220477:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169635968 00000100:00100000:3.0:1790391463.220488:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169635968 00000100:00100000:3.0:1790391463.220661:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 72 00000100:00100000:3.0:1790391463.220673:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:12463:x1877361169635968:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391463.220693:0:9796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391463.220712:0:9796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b04aa expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.220756:0:9796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f78 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04a3 expref: 12 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.220765:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391463.220770:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391463.220775:0:9796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 12 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.220839:0:9796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04a3 expref: 12 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.220854:0:9796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04a3 expref: 12 pid: 10505 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391463.220868:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9796:1877361186463232:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391463.221005:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391463.224359:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.224509:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169636096 00000100:00100000:2.0:1790391463.224520:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169636096 00010000:00010000:2.0:1790391463.224575:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f78 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04a3 expref: 13 pid: 10505 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391463.224639:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 101 00000100:00100000:2.0:1790391463.224652:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:2383:x1877361169636096:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391463.224668:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391463.224693:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f78 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04a3 expref: 13 pid: 10505 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.224707:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04a3 expref: 13 pid: 10505 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.224744:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391463.224749:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391463.224760:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 13 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.224771:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 13 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.224827:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 13 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391463.224845:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1877361186463360:192.168.202.28@tcp:105: 00000100:00100000:2.0:1790391463.224970:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0b410c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790391463.227046:0:9796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f78 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04a3 expref: 13 pid: 10505 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391463.227072:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9796:1877361186463232:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391463.227103:0:9796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 12 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.227118:0:9796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c000, rc 0) 00000100:00100000:3.0:1790391463.227193:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+12:12463:x1877361169635968:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 6521us (6960us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391463.227202:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 72 00000100:00100000:2.0:1790391463.231174:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6497:1877361186463360:192.168.202.28@tcp:105: 00010000:00010000:2.0:1790391463.231240:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391463.231315:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:2383:x1877361169636096:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 6658us (6958us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.231326:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 101 00000100:00100000:0.0:1790391463.237017:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.237131:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169636224 00000100:00100000:2.0:1790391463.237143:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169636224 00002000:00100000:2.0:1790391463.237215:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9e5183b7f480 x1877361169636224/t0(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:329/0 lens 504/0 e 0 to 0 dl 1790391474 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790391463.237227:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5183b7f480 with x1877361169636224 ext(0->12) 00002000:00010000:2.0:1790391463.237232:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5183b7f480 00000100:00100000:2.0:1790391463.237265:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:2.0:1790391463.237276:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+11:2383:x1877361169636224:12345-192.168.202.28@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790391463.239844:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:2383:x1877361169636224:12345-192.168.202.28@tcp:4:lhsmtool_posix.0 Request processed in 2557us (2825us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1790391463.239858:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 6 00002000:00100000:2.0:1790391463.239871:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9e5183b7f480 x1877361169636224/t4294967321(0) o4->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:329/0 lens 504/448 e 0 to 0 dl 1790391474 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790391463.239913:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e5183b7f480 with x1877361169636224 ext(0->12) 00002000:00010000:2.0:1790391463.239919:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e5183b7f480 00000100:00100000:0.0:1790391463.243770:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391463.244023:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169636352 00000100:00100000:3.0:1790391463.244035:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169636352 00000100:00100000:2.0:1790391463.244211:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 244 00000100:00100000:2.0:1790391463.244224:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+73:12463:x1877361169636352:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790391463.246472:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1790391463.246490:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000004:00080000:0.0:1790391463.246694:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1790391463.246715:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e51823a1c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1790391463.246721:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5289d81200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e51823a1600 00000020:00080000:0.0:1790391463.246724:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5289d81b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5281497600 00000004:00080000:0.0:1790391463.246757:0:6491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:3.0:1790391463.246892:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1790391463.246902:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391463.246923:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186463488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790391463.247015:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391463.247071:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186463488 00000100:00100000:3.0:1790391463.247078:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186463488 00000100:00100000:3.0:1790391463.247122:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391463.247131:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3637:x1877361186463488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790391463.247155:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1790391463.247188:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6ab734a6, atime: 0x6ab734a6, ctime: 0x6ab734a6, blocks: 0x8 00010000:00010000:3.0:1790391463.247197:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.247223:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1790391463.247227:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391463.247234:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.247252:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.247263:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.247271:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.247289:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790391463.247438:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3637:x1877361186463488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 308us (423us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1790391463.247457:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:3.0:1790391463.247477:0:13724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391463.247483:0:13724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.247491:0:13724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391463.247496:0:13724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248106:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248116:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248123:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248129:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391463.248133:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248140:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248154:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e5182c83d00) 00010000:00010000:1.0:1790391463.248157:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391463.248162:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248169:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef000/0x2b1b7949f13e1c84 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248223:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248230:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248236:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248241:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763dc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391463.248245:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248251:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248260:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e51821ba200) 00010000:00010000:1.0:1790391463.248262:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391463.248265:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248271:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763dc00/0x2b1b7949f13e1d2c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248301:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248309:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248316:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248328:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391463.248331:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248338:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248346:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6c500) 00010000:00010000:1.0:1790391463.248349:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391463.248352:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248359:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e1daa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248372:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248378:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248385:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248391:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055a00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391463.248393:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248400:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248417:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e52b9b6c500) 00010000:00010000:1.0:1790391463.248420:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391463.248423:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248429:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055a00/0x2b1b7949f13e1dcd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248446:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248453:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248458:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248464:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391463.248466:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248472:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248481:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:1.0:1790391463.248483:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391463.248486:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248493:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e1e9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248531:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248537:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248543:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248547:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391463.248550:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248556:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248564:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:1.0:1790391463.248566:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790391463.248569:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.248575:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1f5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.248764:0:13724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.248846:0:13724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.248855:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036618bfe/0x2b1b7949f13e1f86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.248914:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391463.248917:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391463.248919:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790391463.248965:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5183a40000/2, rc 0, transno 4294967311 00000100:00100000:3.0:1790391463.248974:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186463488:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790391463.252626:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186463744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790391463.252720:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391463.252802:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391463.252814:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186463616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790391463.252837:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391463.252920:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186463744 00000100:00100000:1.0:1790391463.252929:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186463744 00000100:00100000:1.0:1790391463.252986:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186463616 00000100:00100000:1.0:1790391463.252989:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186463616 00000100:00100000:1.0:1790391463.253011:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790391463.253019:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186463744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790391463.253165:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790391463.253169:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1790391463 00002000:00010000:1.0:1790391463.253171:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790391463.253173:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790391463 -> 1790391463 00002000:00010000:1.0:1790391463.253176:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1790391463.253227:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3640:x1877361186463744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (507us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1790391463.253234:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790391463.253252:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790391463.253258:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186463616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790391463.253273:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1790391463.253295:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.253329:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080a9de9c/0x2b1b7949f13e1d3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0402 expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.253340:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790391463.253344:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391463.253349:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.253397:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080a9de9c/0x2b1b7949f13e1d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0402 expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.253414:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080a9de9c/0x2b1b7949f13e1d3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0402 expref: 12 pid: 8427 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391463.253427:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292338380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1877361186463872:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391463.255605:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76850c0 going to sleep for 11 seconds 00000100:00080000:1.0:1790391463.255635:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1790391463.255699:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e51838f7800/2, rc 0, transno 4294967322 00000100:00100000:1.0:1790391463.255709:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186463744:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1790391463.259982:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e51822df240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1790391463.259995:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e52bfa24f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e51822df900 00000020:00080000:0.0:1790391463.259999:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e52bfa24100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e51832b6000 00000100:00100000:1.0:1790391463.260786:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:12463:x1877361169636352:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 Request processed in 16550us (17011us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391463.260799:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 244 00000020:00080000:3.0:1790391463.268833:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1790391463.269031:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1790391463.270137:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.271030:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292338380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1877361186463872:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391463.271060:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391463.272856:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169636480 00000100:00100000:3.0:1790391463.272917:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169636480 00010000:00010000:3.0:1790391463.272962:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080a9de9c/0x2b1b7949f13e1d3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0402 expref: 13 pid: 8427 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391463.273203:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391463.273297:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 102 00000100:00100000:3.0:1790391463.273318:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:2384:x1877361169636480:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391463.273335:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391463.273343:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080a9de9c/0x2b1b7949f13e1d3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0402 expref: 13 pid: 8427 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.273358:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080a9de9c/0x2b1b7949f13e1d3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0402 expref: 13 pid: 8427 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.273382:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080a9de9c/0x2b1b7949f13e1d3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0402 expref: 13 pid: 8427 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.273400:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391463.273405:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391463.273411:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.273422:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.273456:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391463.273689:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.273700:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.273721:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.273742:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.273766:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790391463.273958:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3640:x1877361186463616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20698us (21118us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1790391463.273967:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790391463.273999:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169636608 00000100:00100000:1.0:1790391463.274004:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169636608 00000100:00100000:1.0:1790391463.274033:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 76 00000100:00100000:1.0:1790391463.274040:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:2384:x1877361169636608:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1790391463.274118:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e51838f6a00/2, rc 0, transno 4294967323 00000100:00100000:1.0:1790391463.274125:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186463616:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1790391463.274323:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391463.274331:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.274352:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391463.274357:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.274366:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.274381:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.274389:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001e79715/0x2b1b7949f13e1f8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.274416:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391463.274418:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391463.274420:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391463.274648:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+13:2384:x1877361169636480:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 1339us (4517us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391463.274669:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 102 00000001:00080000:3.0:1790391463.287407:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1790391463.287427:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1790391463.287632:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169636608:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 Request processed in 13586us (14424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391463.287644:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 76 00000100:00100000:1.0:1790391463.313365:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.313622:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169636864 00000100:00100000:2.0:1790391463.313640:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169636864 00000100:00100000:2.0:1790391463.313749:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 245 00000100:00100000:2.0:1790391463.313762:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:12463:x1877361169636864:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790391463.313844:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391463.313917:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1f71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b049c expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.313945:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:2.0:1790391463.313971:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391463.314023:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.314038:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.314050:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391463.314202:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bb6d9d8 reply state 00000000f8a3ae62 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.314472:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.314478:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:2.0:1790391463.314481:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790391463.314484:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790391463.314607:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:12463:x1877361169636864:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 846us (1266us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1790391463.314615:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 245 00000100:00100000:3.0:1790391463.331667:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.333679:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169636992 00000100:00100000:1.0:1790391463.333702:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169636992 00000100:00100000:1.0:1790391463.334181:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 77 00000100:00100000:1.0:1790391463.334196:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169636992:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790391463.335524:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790391463.335535:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1790391463 -> 1790391463 00002000:00010000:1.0:1790391463.335538:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1790391462 00002000:00010000:1.0:1790391463.335541:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1790391463 -> 1790391463 00002000:00010000:1.0:1790391463.335543:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1790391463.335720:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169636992:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 1523us (4063us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1790391463.335748:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 77 00000100:00100000:0.0:1790391463.344580:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391463.345439:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169637248 00000100:00100000:3.0:1790391463.345454:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169637248 00000100:00100000:3.0:1790391463.345544:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 246 00000100:00100000:3.0:1790391463.345556:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:12463:x1877361169637248:12345-192.168.202.28@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790391463.345657:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.345681:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b048e expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.345692:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.346154:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b048e expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.346175:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b048e expref: 22 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391463.346195:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186464000:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391463.348547:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727600 going to sleep for 11 seconds 00000100:00100000:3.0:1790391463.351661:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1877361186464000:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391463.351706:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391463.355675:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.356240:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169637376 00000100:00100000:1.0:1790391463.356255:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169637376 00010000:00010000:1.0:1790391463.356327:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b048e expref: 23 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391463.356503:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 103 00000100:00100000:1.0:1790391463.356518:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+23:2384:x1877361169637376:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391463.356541:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391463.356551:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b048e expref: 23 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.356569:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b048e expref: 23 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.356597:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e1f55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b048e expref: 23 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.356619:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:1.0:1790391463.356647:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.356660:0:10388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.356669:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.356710:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391463.356803:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:2384:x1877361169637376:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 286us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391463.356812:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 103 00010000:00010000:3.0:1790391463.356927:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.356937:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.356990:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.356999:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.357007:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.357013:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391463.357018:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.357027:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.357037:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:3.0:1790391463.357040:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790391463.357044:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.357049:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1f9b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391463.357099:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:12463:x1877361169637248:12345-192.168.202.28@tcp:55:lhsmtool_posix.0 Request processed in 11544us (12537us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790391463.357116:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 246 00000100:00100000:0.0:1790391463.361083:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391463.361189:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169637504 00000100:00100000:3.0:1790391463.361203:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169637504 00000100:00100000:3.0:1790391463.361285:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 78 00000100:00100000:3.0:1790391463.361298:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169637504:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790391463.361597:0:9796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.361627:0:9796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 8 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.361638:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391463.361643:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391463.361650:0:9796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.361704:0:9796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 8 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.361723:0:9796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 8 pid: 9796 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391463.361753:0:9796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9796:1877361186464128:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391463.361872:0:9796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727600 going to sleep for 11 seconds 00000100:00100000:3.0:1790391463.365698:0:9796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9796:1877361186464128:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391463.365782:0:9796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391463.366820:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.367180:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169637632 00000100:00100000:2.0:1790391463.367195:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169637632 00010000:00010000:2.0:1790391463.367275:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 9 pid: 9796 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391463.367329:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 104 00000100:00100000:2.0:1790391463.367341:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+9:2384:x1877361169637632:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391463.367476:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391463.367526:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 9 pid: 9796 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.367544:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 9 pid: 9796 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.367574:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000f7b009/0x2b1b7949f13e1f7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04aa expref: 9 pid: 9796 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.367598:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391463.367603:0:6499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790391463.367610:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.367622:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.367670:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391463.367827:0:9796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.367839:0:9796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.367865:0:9796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.367907:0:9796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.367916:0:9796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.367924:0:9796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391463.367929:0:9796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.367940:0:9796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.367953:0:9796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.367970:0:9796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006418eb9d/0x2b1b7949f13e1fa2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391463.368090:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2384:x1877361169637632:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 750us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.368100:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 104 00000100:00100000:0.0:1790391463.369840:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169637504:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 Request processed in 8529us (8758us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391463.369857:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 78 00000100:00100000:0.0:1790391463.373777:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.373872:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169637888 00000100:00100000:2.0:1790391463.373953:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169637888 00000100:00100000:2.0:1790391463.374041:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 247 00000100:00100000:2.0:1790391463.374054:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:12463:x1877361169637888:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790391463.374183:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.374235:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0456 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.374248:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.374296:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0456 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.374327:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0456 expref: 21 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391463.374347:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186464256:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391463.374472:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a0b41e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391463.380322:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186464256:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391463.380372:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391463.380757:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.380833:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169638016 00000100:00100000:2.0:1790391463.380842:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169638016 00010000:00010000:2.0:1790391463.380923:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0456 expref: 22 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391463.381007:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 105 00000100:00100000:2.0:1790391463.381019:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:2383:x1877361169638016:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391463.381037:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391463.381074:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0456 expref: 22 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.381088:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0456 expref: 22 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.381113:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055000/0x2b1b7949f13e1e98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0456 expref: 22 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.381131:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391463.381137:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1efa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0479 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.381149:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.381157:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.381165:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.381200:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391463.381268:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:2383:x1877361169638016:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 251us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.381276:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 105 00010000:00010000:3.0:1790391463.381396:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.381405:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.381643:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.381659:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f63 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0495 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.381668:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.381705:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0495 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.381721:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0495 expref: 21 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391463.381750:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186464384:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391463.381822:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391463.392414:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186464384:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391463.392459:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391463.393709:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.393820:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169638144 00000100:00100000:2.0:1790391463.393834:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169638144 00010000:00010000:2.0:1790391463.393945:0:6499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0495 expref: 22 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391463.394009:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 106 00000100:00100000:2.0:1790391463.394022:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:2384:x1877361169638144:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391463.394047:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391463.394056:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0495 expref: 22 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.394071:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0495 expref: 22 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.394100:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1f63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0495 expref: 22 pid: 6513 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.394120:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:2.0:1790391463.394127:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.394140:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.394149:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.394184:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391463.394263:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:2384:x1877361169638144:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 244us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.394271:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 106 00010000:00010000:0.0:1790391463.394479:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391463.394488:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790391463.394643:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1790391463.394805:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1790391463.394847:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1790391463.394996:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186464512:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790391463.395065:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391463.395105:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391463.395510:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186464512 00000100:00100000:2.0:1790391463.395531:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186464512 00000100:00100000:2.0:1790391463.397896:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1790391463.397931:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290bce050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1877361186464512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790391463.398121:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290bce050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1877361186464512:12345-0@lo:1000:mdt00_000.0 Request processed in 210us (3055us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.398130:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1790391463.398933:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1790391463.398944:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:3.0:1790391463.398970:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e51838f7800, transno 4294967322 00000004:00080000:3.0:1790391463.398996:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e51838f6a00, transno 4294967323 00000100:00100000:3.0:1790391463.399007:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186464512:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1790391463.399207:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1790391463.399309:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186464640:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790391463.404945:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391463.405214:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391463.407395:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186464640 00000100:00100000:0.0:1790391463.407420:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186464640 00000100:00100000:0.0:1790391463.407544:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1790391463.407559:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6512:x1877361186464640:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790391463.407914:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1877361186464640:12345-0@lo:1000:mdt00_000.0 Request processed in 358us (2976us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1790391463.407940:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790391463.408073:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1877361186464640:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1790391463.408140:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408276:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408284:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408290:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391463.408294:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408302:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408318:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:3.0:1790391463.408322:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391463.408344:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408351:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fb0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408383:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408390:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408396:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408401:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391463.408404:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408410:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408418:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:3.0:1790391463.408421:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391463.408428:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1efa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0479 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408439:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1efa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0479 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408448:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1efa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0479 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.408505:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1efa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0479 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391463.408522:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186464768:192.168.202.28@tcp:105: 00000100:00100000:3.0:1790391463.408621:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae89e300 going to sleep for 11 seconds 00000100:00100000:0.0:1790391463.411222:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.411316:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169638272 00000100:00100000:2.0:1790391463.411329:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169638272 00000100:00100000:2.0:1790391463.411398:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:2.0:1790391463.411409:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:12462:x1877361169638272:12345-192.168.202.28@tcp:49:lfs.0 00000100:00100000:2.0:1790391463.411585:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+25:12462:x1877361169638272:12345-192.168.202.28@tcp:49:lfs.0 Request processed in 176us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.411594:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:3.0:1790391463.412439:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1877361186464768:192.168.202.28@tcp:105: 00010000:00010000:3.0:1790391463.412476:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412491:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055e00/0x2b1b7949f13e1ef3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412534:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412553:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412567:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412579:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412586:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fb7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412592:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412621:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391463.412626:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412634:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fb7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412648:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:3.0:1790391463.412651:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391463.412656:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fb7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412662:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fb7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412675:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412681:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412688:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412694:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391463.412697:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412703:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412724:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:3.0:1790391463.412739:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391463.412743:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.412749:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054c00/0x2b1b7949f13e1fa9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790391463.414530:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391463.414544:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391463.415110:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1790391463.415137:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790391463.422346:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:12463:x1877361169637888:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 48271us (48565us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1790391463.423399:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 247 00000020:00080000:3.0:1790391463.423415:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1790391463.428437:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.428714:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169638528 00000100:00100000:2.0:1790391463.428738:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169638528 00000100:00100000:2.0:1790391463.428827:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 248 00000100:00100000:2.0:1790391463.428840:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:12462:x1877361169638528:12345-192.168.202.28@tcp:58:lfs.0 00000040:00080000:2.0:1790391463.429139:0:10091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1790391463.429252:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:12462:x1877361169638528:12345-192.168.202.28@tcp:58:lfs.0 Request processed in 415us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391463.429262:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 248 00000100:00100000:1.0:1790391463.441781:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.442429:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169638784 00000100:00100000:2.0:1790391463.442444:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169638784 00000100:00100000:2.0:1790391463.442575:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 62 00000100:00100000:2.0:1790391463.442588:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+24:12463:x1877361169638784:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790391463.446720:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790391463.446806:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1790391463.446870:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.446917:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.446934:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.446946:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.446954:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.446961:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391463.446996:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790391463.447154:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+26:12463:x1877361169638784:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 4562us (5384us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1790391463.447167:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 62 00000020:00080000:2.0:1790391463.447175:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790391463.447308:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391463.447317:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.447324:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391463.447329:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.447338:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.447352:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:1.0:1790391463.447363:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790391463.447369:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.447375:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e1fbe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.447389:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391463.447390:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391463.447392:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391463.543867:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.544034:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169638912 00000100:00100000:1.0:1790391463.544049:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169638912 00000100:00100000:1.0:1790391463.544120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 249 00000100:00100000:1.0:1790391463.544129:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+26:12465:x1877361169638912:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391463.544159:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391463.544185:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1fc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b04b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544282:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1fcc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544309:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1fcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544324:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1fcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544342:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1fd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544349:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544378:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544503:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544513:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0472 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544523:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544563:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0472 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.544577:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0472 expref: 27 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391463.544594:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292338700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186464896:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391463.544704:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a76850c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391463.549734:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391463.550329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169639168 00000100:00100000:2.0:1790391463.550343:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169639168 00000100:00100000:2.0:1790391463.550529:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:2.0:1790391463.550542:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:6156:x1877361169639168:12345-192.168.202.28@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790391463.550938:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:6156:x1877361169639168:12345-192.168.202.28@tcp:35:ldlm_bl.0 Request processed in 396us (1224us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1790391463.550946:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:1.0:1790391463.551075:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292338700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1877361186464896:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391463.551106:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391463.554668:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391463.554801:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169639296 00000100:00100000:1.0:1790391463.554816:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169639296 00010000:00010000:1.0:1790391463.554868:0:10388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0472 expref: 29 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391463.554994:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 107 00000100:00100000:1.0:1790391463.555005:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:2384:x1877361169639296:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391463.555024:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391463.555033:0:10388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0472 expref: 29 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.555048:0:10388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0472 expref: 29 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.555076:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e1ee5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0472 expref: 29 pid: 6514 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.555096:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:1.0:1790391463.555103:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.555114:0:10388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.555124:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391463.555168:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391463.555240:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:2384:x1877361169639296:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 237us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391463.555246:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 107 00010000:00010000:3.0:1790391463.556593:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.556611:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391463.557198:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790391463.557204:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391463.557233:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557252:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557264:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1fcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557271:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1fcc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557303:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1fcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557309:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087e00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391463.557314:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1fcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557323:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1fcc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557340:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:3.0:1790391463.557343:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391463.557348:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1fcc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557355:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087e00/0x2b1b7949f13e1fcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557372:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557379:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557385:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557390:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391463.557393:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557409:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557418:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e5283a48300) 00010000:00010000:3.0:1790391463.557420:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391463.557423:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1fd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557429:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e1fd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557475:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086c00/0x2b1b7949f13e1fc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04b1 expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557489:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04b1 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391463.557962:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:3.0:1790391463.557965:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391463.557968:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087000, rc 0) 00000100:00100000:3.0:1790391463.561391:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12465:x1877361169638912:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 17250us (17526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391463.561405:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 249 00010000:00010000:1.0:1790391463.880554:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391464.010998:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1790391464.032771:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1790391464.032789:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:2.0:1790391464.447405:0:14754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790391464.447415:0:14754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391464.447450:0:14754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790391464.447456:0:14754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790391464.456418:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000040:00080000:1.0:1790391464.456578:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391464.456584:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391464.456610:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790391464.456618:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391464.456754:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292338700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186465152:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391464.456860:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391464.463281:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186465280:0@lo:400:kworker.0 00000100:00100000:2.0:1790391464.463430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391464.463481:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186465024:0@lo:400:kworker.0 00000100:00100000:2.0:1790391464.463512:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391464.463572:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186465280 00000100:00100000:2.0:1790391464.463581:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186465280 00000100:00100000:1.0:1790391464.463582:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186465024 00000100:00100000:1.0:1790391464.463585:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186465024 00000100:00100000:2.0:1790391464.463625:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1790391464.463625:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1790391464.463633:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186465280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.463633:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186465024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.463686:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186465024:12345-0@lo:400:kworker.0 Request processed in 53us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391464.463693:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1790391464.463760:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186465280:12345-0@lo:400:kworker.0 Request processed in 127us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391464.463766:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1790391464.463960:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186465280:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.463971:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186465024:0@lo:400:kworker.0 00000100:00100000:2.0:1790391464.465427:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186465408:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.465608:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186465536:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.465659:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391464.465693:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186466048:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.465728:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391464.465758:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186466560:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.465779:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391464.465799:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790391464.465805:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186465920:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.465827:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391464.465840:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186466432:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.465893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391464.465924:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186466048 00000100:00100000:1.0:1790391464.465932:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186466048 00000100:00100000:1.0:1790391464.465981:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186466560 00000100:00100000:1.0:1790391464.465984:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186466560 00000100:00100000:1.0:1790391464.466007:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790391464.466015:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186466048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466061:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186466048:12345-0@lo:400:kworker.0 Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391464.466067:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790391464.466076:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391464.466082:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790391464.466088:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186466560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466132:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186466560:12345-0@lo:400:kworker.0 Request processed in 44us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391464.466138:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1790391464.466158:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391464.466161:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391464.466176:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186465536 00000100:00100000:1.0:1790391464.466180:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186465536 00000100:00100000:1.0:1790391464.466205:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186465920 00000100:00100000:1.0:1790391464.466208:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186465920 00000100:00100000:1.0:1790391464.466222:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186466432 00000100:00100000:1.0:1790391464.466225:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186466432 00000100:00100000:1.0:1790391464.466240:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1790391464.466245:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186465536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466276:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186465536:12345-0@lo:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391464.466282:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1790391464.466302:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1790391464.466308:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186465920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466337:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186465920:12345-0@lo:400:kworker.0 Request processed in 31us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391464.466343:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1790391464.466355:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1790391464.466360:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186466432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466386:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186466432:12345-0@lo:400:kworker.0 Request processed in 26us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391464.466392:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:1.0:1790391464.466408:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1790391464.466431:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831dea00 x1877361186465920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391464.466444:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186465920:0@lo:400:kworker.0 00010000:00080000:1.0:1790391464.466454:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51831df480 x1877361186466432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391464.466463:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186466432:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466473:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186466560:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466481:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186465536:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466488:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186466048:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466514:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186465792:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466538:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391464.466560:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186465792 00000100:00100000:1.0:1790391464.466569:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186465792 00000100:00100000:1.0:1790391464.466595:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1790391464.466601:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186465792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.466634:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186465792:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391464.466640:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00080000:1.0:1790391464.466654:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391464.469068:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186465664:0@lo:400:kworker.0 00000100:00100000:2.0:1790391464.469573:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186465408 00000100:00100000:2.0:1790391464.469581:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186465408 00000100:00100000:2.0:1790391464.469628:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1790391464.469637:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186465408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391464.469693:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186465408:12345-0@lo:400:kworker.0 Request processed in 57us (3615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391464.469700:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1790391464.471553:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186465792:0@lo:400:kworker.0 00000100:00100000:3.0:1790391464.471644:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391464.471701:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186466176:0@lo:400:kworker.0 00000100:00100000:3.0:1790391464.471773:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391464.471803:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186466688:0@lo:400:kworker.0 00000100:00100000:3.0:1790391464.471828:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391464.471899:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186466176 00000100:00100000:3.0:1790391464.471906:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186466176 00000100:00100000:3.0:1790391464.472007:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186466688 00000100:00100000:3.0:1790391464.472012:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186466688 00000100:00100000:3.0:1790391464.472043:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790391464.472051:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186466176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391464.472099:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186466176:12345-0@lo:400:kworker.0 Request processed in 48us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391464.472106:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790391464.472121:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790391464.472128:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186466688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391464.472155:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186466688:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391464.472348:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1790391464.472367:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391464.472391:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186466176:0@lo:400:kworker.0 00000100:00100000:3.0:1790391464.472400:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1790391464.472405:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1790391464.472422:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e51830a7b80, transno 4294967308 00000004:00080000:3.0:1790391464.472430:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1790391464.472451:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5183a40000, transno 4294967311 00000100:00100000:3.0:1790391464.472467:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186466688:0@lo:400:kworker.0 00000100:00100000:1.0:1790391464.472563:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186465408:0@lo:400:kworker.0 00000100:00100000:3.0:1790391464.473248:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186466304:0@lo:400:kworker.0 00000100:00100000:3.0:1790391464.473371:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391464.473454:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186465664 00000100:00100000:2.0:1790391464.473469:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186465664 00000100:00100000:2.0:1790391464.473510:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1790391464.473517:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186465664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391464.473565:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186465664:12345-0@lo:400:kworker.0 Request processed in 49us (4107us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391464.473572:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1790391464.473606:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186465664:0@lo:400:kworker.0 00000100:00100000:0.0:1790391464.476620:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186466304 00000100:00100000:0.0:1790391464.476638:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186466304 00000100:00100000:0.0:1790391464.476725:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1790391464.476737:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186466304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391464.476845:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186466304:12345-0@lo:400:kworker.0 Request processed in 111us (3545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391464.476853:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1790391464.476928:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186466304:0@lo:400:kworker.0 00000100:00080000:3.0:1790391464.478522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391464.478777:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292338700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13791:1877361186465152:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790391464.480467:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391464.482035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169639424 00000100:00100000:3.0:1790391464.482051:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169639424 00000100:00100000:3.0:1790391464.482131:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 250 00000100:00100000:3.0:1790391464.482142:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12476:x1877361169639424:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790391464.482180:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790391464.482322:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12476:x1877361169639424:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 181us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391464.482336:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 250 00000100:00100000:0.0:1790391464.493116:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391464.493238:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169639680 00000100:00100000:3.0:1790391464.493251:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169639680 00000100:00100000:3.0:1790391464.493316:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 251 00000100:00100000:3.0:1790391464.493327:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+27:12476:x1877361169639680:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790391464.493345:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391464.493370:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fe1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b04b8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.493485:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fe8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.493500:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.493512:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391464.493523:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790391464.493655:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763c800/0x2b1b7949f13e1fe1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04b8 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.493673:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04b8 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.493682:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:3.0:1790391464.493685:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790391464.493688:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d600, rc 0) 00000100:00100000:3.0:1790391464.493756:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:12476:x1877361169639680:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 431us (661us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790391464.493762:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 251 00000100:00100000:2.0:1790391464.502805:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391464.502862:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391464.502917:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169640064 00000100:00100000:2.0:1790391464.502927:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169640064 00000100:00100000:2.0:1790391464.503010:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:2.0:1790391464.503022:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:2382:x1877361169640064:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391464.503038:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391464.503064:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763d600/0x2b1b7949f13e1fe8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04b8 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391464.503082:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:2.0:1790391464.503088:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391464.503145:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:2382:x1877361169640064:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 125us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391464.503154:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:3.0:1790391464.504378:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169639936 00000100:00100000:3.0:1790391464.504390:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169639936 00000100:00100000:3.0:1790391464.504516:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 252 00000100:00100000:3.0:1790391464.504526:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+28:12476:x1877361169639936:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790391464.504616:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1ff6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.504633:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.504645:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.504803:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.504812:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1ff6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.504830:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.504835:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763da00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391464.504839:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.504847:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1ff6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.504857:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:3.0:1790391464.504860:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790391464.504864:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1ff6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391464.504871:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e1ff6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391464.505340:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:12476:x1877361169639936:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 813us (2544us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1790391464.505348:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 252 00000040:00080000:0.0:1790391464.507826:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391464.507836:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391464.508418:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790391464.508433:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790391464.522316:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391464.522359:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169640320 00000100:00100000:3.0:1790391464.522369:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169640320 00000100:00100000:3.0:1790391464.522421:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:3.0:1790391464.522432:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+29:12476:x1877361169640320:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790391464.522676:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:12476:x1877361169640320:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 245us (371us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1790391464.522694:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 64 00010000:00010000:3.0:1790391464.904046:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391464.968251:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186466816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391464.968338:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391464.968415:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186466816 00000100:00100000:1.0:1790391464.968423:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186466816 00000100:00100000:1.0:1790391464.968476:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790391464.968486:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186466816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391464.968515:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391464.968561:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186466816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391464.968579:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790391464.970197:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186466816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391464.972411:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391464.973349:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186466944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391464.973426:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391464.973638:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186466944 00000100:00100000:3.0:1790391464.973647:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186466944 00000100:00100000:3.0:1790391464.973698:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790391464.973708:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186466944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790391464.973740:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391464.973800:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186466944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391464.973806:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790391464.974216:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186466944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391465.877129:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391465.877174:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391465.877199:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391465.877225:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391465.877228:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169640448 00000100:00100000:0.0:1790391465.877239:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169640448 00000100:00100000:1.0:1790391465.877247:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391465.877272:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391465.877294:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 393 00000100:00100000:1.0:1790391465.877308:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391465.877308:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169640448:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391465.877332:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169640960 00000100:00100000:1.0:1790391465.877344:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169640960 00000100:00100000:0.0:1790391465.877391:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169640448:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391465.877392:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169640832 00000100:00100000:1.0:1790391465.877398:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169640832 00000100:00100000:0.0:1790391465.877401:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 393 00000100:00100000:1.0:1790391465.877425:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 167 00000100:00100000:1.0:1790391465.877436:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169640960:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391465.877437:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169640576 00000100:00100000:0.0:1790391465.877443:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169640576 00000100:00100000:1.0:1790391465.877475:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169640960:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 41us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391465.877476:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169640704 00000100:00100000:0.0:1790391465.877480:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169640704 00000100:00100000:1.0:1790391465.877485:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 167 00000100:00100000:0.0:1790391465.877503:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169641216 00000100:00100000:1.0:1790391465.877507:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 168 00000100:00100000:0.0:1790391465.877507:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169641216 00000100:00100000:1.0:1790391465.877519:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169640832:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391465.877541:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169641088 00000100:00100000:0.0:1790391465.877545:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169641088 00000100:00100000:1.0:1790391465.877547:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169640832:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391465.877555:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 168 00000100:00100000:0.0:1790391465.877564:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 335 00000100:00100000:0.0:1790391465.877572:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:2384:x1877361169640576:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391465.877582:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 336 00000100:00100000:1.0:1790391465.877591:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169640704:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391465.877634:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169640704:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 45us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391465.877641:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 336 00000100:00100000:1.0:1790391465.877655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 337 00000100:00100000:1.0:1790391465.877661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169641216:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391465.877681:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169641216:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 20us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391465.877687:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 337 00000100:00100000:1.0:1790391465.877698:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 338 00000100:00100000:1.0:1790391465.877724:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169641088:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391465.877754:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:2384:x1877361169640576:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 182us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391465.877761:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169641088:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 36us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391465.877767:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 335 00000100:00100000:1.0:1790391465.877776:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 338 00000100:00080000:1.0:1790391465.877808:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391465.877812:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391465.877815:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391465.877817:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790391465.944930:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391465.996145:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186467072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391465.996212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391465.996283:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186467072 00000100:00100000:0.0:1790391465.996289:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186467072 00000100:00100000:0.0:1790391465.996330:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790391465.996337:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186467072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391465.996368:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790391465.996406:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186467072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391465.996413:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790391465.996452:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186467072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391465.996973:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186467200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391465.997007:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391465.997108:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391465.997134:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186467200 00000100:00100000:0.0:1790391465.997138:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186467200 00000100:00100000:0.0:1790391465.997174:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790391465.997181:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186467200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391465.997199:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790391465.998310:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186467328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391465.998361:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790391465.998689:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391465.998719:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186467328 00000100:00100000:1.0:1790391465.998726:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186467328 00000100:00100000:1.0:1790391465.998825:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790391465.998834:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186467328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790391465.999309:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1790391465.999368:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186467328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 534us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391465.999376:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790391466.004948:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186467200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7756us (7929us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391466.004965:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790391466.005214:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186467200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391466.005667:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186467328:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1790391466.535803:0:14806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790391466.535812:0:14806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790391466.535843:0:14806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790391466.535850:0:14806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790391466.848527:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391466.848805:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169641472 00000100:00100000:1.0:1790391466.848816:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169641472 00000100:00100000:1.0:1790391466.848931:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 253 00000100:00100000:1.0:1790391466.848942:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+30:12497:x1877361169641472:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391466.848964:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391466.848984:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ffd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b04bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.849094:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e2004 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.849123:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e2004 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.849138:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e2004 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391466.849152:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790391466.849257:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e1ffd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04bf expref: 33 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.849275:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e2004 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04bf expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391466.849284:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:1.0:1790391466.849287:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790391466.849290:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086600, rc 0) 00000100:00100000:1.0:1790391466.849354:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:12497:x1877361169641472:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 413us (836us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1790391466.849362:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 253 00000100:00100000:1.0:1790391466.859138:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391466.859315:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169641600 00000100:00100000:3.0:1790391466.859325:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169641600 00000100:00100000:3.0:1790391466.859383:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 254 00000100:00100000:3.0:1790391466.859401:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:12497:x1877361169641600:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:3.0:1790391466.859471:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e2012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391466.859488:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e2012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391466.859500:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e2012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391466.859547:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e2012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391466.859571:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e2012 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391466.859578:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e2012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391466.859583:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763da00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391466.859905:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e2012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391466.859915:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e2012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391466.859928:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:3.0:1790391466.859931:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790391466.859936:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e2012 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391466.859943:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763da00/0x2b1b7949f13e2012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391466.860034:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+32:12497:x1877361169641600:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 641us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391466.860043:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 254 00010000:00010000:1.0:1790391466.952090:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391466.971810:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391466.971998:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169641728 00000100:00100000:0.0:1790391466.972008:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169641728 00000100:00100000:0.0:1790391466.972117:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 79 00000100:00100000:0.0:1790391466.972129:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2382:x1877361169641728:12345-192.168.202.28@tcp:101:cat.0 00010000:00010000:0.0:1790391466.972147:0:9796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391466.972168:0:9796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e2019 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b04c6 expref: -99 pid: 9796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391466.972207:0:9796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6ab734a7, atime: 0x6ab734a6, ctime: 0x6ab734a7, blocks: 0x8 00010000:00010000:0.0:1790391466.972228:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1790391466.972232:0:9796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391466.972242:0:9796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e2019 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04c6 expref: 8 pid: 9796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.972259:0:9796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e2019 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04c6 expref: 8 pid: 9796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391466.972272:0:9796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefa00, rc 0) 00000100:00100000:0.0:1790391466.972368:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2382:x1877361169641728:12345-192.168.202.28@tcp:101:cat.0 Request processed in 242us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391466.972376:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 79 00000100:00100000:2.0:1790391466.976106:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391466.976195:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169641856 00000100:00100000:3.0:1790391466.976205:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169641856 00002000:00100000:3.0:1790391466.976252:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9e51838f5180 x1877361169641856/t0(0) o3->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:332/0 lens 488/0 e 0 to 0 dl 1790391477 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790391466.976280:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e51838f5180 with x1877361169641856 ext(0->4095) 00002000:00010000:3.0:1790391466.976286:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e51838f5180 00000100:00100000:3.0:1790391466.976318:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:3.0:1790391466.976328:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169641856:12345-192.168.202.28@tcp:3:cat.0 00000100:00100000:3.0:1790391466.976490:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+8:2383:x1877361169641856:12345-192.168.202.28@tcp:3:cat.0 Request processed in 163us (392us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790391466.976498:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00002000:00100000:3.0:1790391466.976505:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9e51838f5180 x1877361169641856/t0(0) o3->70c6d8ed-6335-49ea-b8ad-c4d19ba2541d@192.168.202.28@tcp:332/0 lens 488/4536 e 0 to 0 dl 1790391477 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790391466.976512:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e51838f5180 with x1877361169641856 ext(0->4095) 00002000:00010000:3.0:1790391466.976515:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e51838f5180 00010000:00010000:1.0:1790391467.976088:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391468.041725:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186467456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391468.041814:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391468.042016:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186467456 00000100:00100000:3.0:1790391468.042024:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186467456 00000100:00100000:3.0:1790391468.042077:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1790391468.042087:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186467456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790391468.042119:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1790391468.047505:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186467456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5407us (5679us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391468.047532:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790391468.049035:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186467456:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1790391468.558731:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1790391468.558771:0:6491:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e52b77279c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1790391468.558777:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5284e83600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e52b7727f00 00000020:00080000:0.0:1790391468.558780:0:6491:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e5284e83800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e5183bb3e00 00000020:00080000:0.0:1790391468.558801:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1790391468.558813:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1790391468.558915:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1790391468.558975:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391468.558987:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391468.558995:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391468.559001:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391468.559006:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391468.559014:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391468.559032:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e52b9b6ce00) 00010000:00010000:2.0:1790391468.559042:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391468.559048:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391468.559055:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184054400/0x2b1b7949f13e1f94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391469.000138:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391469.580382:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186467584:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.580473:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.580518:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186468096:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.580542:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.580561:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186468608:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.580582:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.580600:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186469120:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.580619:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.580643:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790391469.580648:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186467968:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.580682:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.580700:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186468480:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.580732:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.580750:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186468992:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.580769:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.580808:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186467840:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.580831:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.580849:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186468352:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.580868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.580922:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186468864:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.580958:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.580981:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790391469.580986:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186467712:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581005:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.581023:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186468224:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581041:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.581050:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186468736:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581066:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391469.581089:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186467584 00000100:00100000:2.0:1790391469.581097:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186467584 00000100:00100000:2.0:1790391469.581144:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1790391469.581152:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186467584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581201:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3640:x1877361186467584:12345-0@lo:400:kworker.0 Request processed in 49us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391469.581209:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1790391469.581239:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186468096 00000100:00100000:2.0:1790391469.581243:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186468096 00000100:00100000:2.0:1790391469.581265:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186467840 00000100:00100000:2.0:1790391469.581267:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186467840 00000100:00100000:0.0:1790391469.581277:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186467968 00000100:00100000:2.0:1790391469.581279:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790391469.581281:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186467968 00000100:00100000:2.0:1790391469.581284:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186468096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391469.581301:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186468352 00000100:00100000:0.0:1790391469.581303:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186468352 00000100:00100000:2.0:1790391469.581317:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186468096:12345-0@lo:400:kworker.0 Request processed in 32us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391469.581322:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186468864 00000100:00100000:2.0:1790391469.581324:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790391469.581325:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186468864 00000100:00100000:2.0:1790391469.581334:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790391469.581337:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186467712 00000100:00100000:2.0:1790391469.581339:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186467840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391469.581339:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186467712 00000100:00100000:0.0:1790391469.581348:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186468224 00000100:00100000:0.0:1790391469.581350:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186468224 00000100:00100000:0.0:1790391469.581361:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186468736 00000100:00100000:0.0:1790391469.581363:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186468736 00000100:00100000:2.0:1790391469.581376:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186467840:12345-0@lo:400:kworker.0 Request processed in 37us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391469.581377:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1790391469.581383:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1790391469.581383:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186467968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581400:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186468608 00000100:00100000:2.0:1790391469.581403:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186468608 00000100:00100000:0.0:1790391469.581415:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877361186467968:12345-0@lo:400:kworker.0 Request processed in 32us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391469.581420:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1790391469.581427:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186469120 00000100:00100000:2.0:1790391469.581429:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186469120 00000100:00100000:0.0:1790391469.581432:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1790391469.581437:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186468352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581438:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186468480 00000100:00100000:2.0:1790391469.581440:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186468480 00000100:00100000:2.0:1790391469.581449:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186468992 00000100:00100000:2.0:1790391469.581452:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186468992 00000100:00100000:2.0:1790391469.581463:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790391469.581469:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186468608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391469.581470:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186468352:12345-0@lo:400:kworker.0 Request processed in 32us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391469.581475:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1790391469.581486:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1790391469.581492:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186468864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581496:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186468608:12345-0@lo:400:kworker.0 Request processed in 28us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391469.581502:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790391469.581511:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790391469.581513:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186468864:12345-0@lo:400:kworker.0 Request processed in 21us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391469.581516:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186469120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391469.581518:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1790391469.581527:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1790391469.581532:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186467712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581539:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186469120:12345-0@lo:400:kworker.0 Request processed in 23us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391469.581544:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790391469.581553:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790391469.581558:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186468480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581583:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186468480:12345-0@lo:400:kworker.0 Request processed in 25us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391469.581588:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790391469.581598:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790391469.581609:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186468992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581636:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186468992:12345-0@lo:400:kworker.0 Request processed in 28us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391469.581642:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790391469.581665:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1790391469.581685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186468224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186468224:12345-0@lo:400:kworker.0 Request processed in 44us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391469.581722:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1790391469.581735:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1790391469.581741:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186468736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581765:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186468736:12345-0@lo:400:kworker.0 Request processed in 25us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391469.581771:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1790391469.581831:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186468224:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581842:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186468736:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581851:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186467840:0@lo:400:kworker.0 00010000:00080000:2.0:1790391469.581862:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838f6a00 x1877361186468352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391469.581872:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186468352:0@lo:400:kworker.0 00010000:00080000:2.0:1790391469.581903:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b7e300 x1877361186468864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391469.581911:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186468864:0@lo:400:kworker.0 00000100:00100000:0.0:1790391469.581919:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186467712:12345-0@lo:400:kworker.0 Request processed in 387us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391469.581925:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1790391469.581945:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186467712:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581964:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877361186467968:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581972:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186468480:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581981:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186468992:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581988:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186467584:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.581996:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186468096:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.582006:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186468608:0@lo:400:kworker.0 00000100:00100000:2.0:1790391469.582014:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186469120:0@lo:400:kworker.0 00000100:00080000:1.0:1790391469.583516:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391469.583526:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391469.583536:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391469.583538:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:3.0:1790391469.584562:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1790391469.584573:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:3.0:1790391470.024074:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391470.088050:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391470.088074:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186469248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391470.088148:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391470.088210:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186469248 00000100:00100000:2.0:1790391470.088218:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186469248 00000100:00100000:2.0:1790391470.088271:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790391470.088280:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186469248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790391470.088307:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790391470.088349:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186469248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391470.088357:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790391470.088401:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186469248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391470.088986:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391470.088997:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186469376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790391470.089034:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391470.091947:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186469376 00000100:00100000:0.0:1790391470.091961:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186469376 00000100:00100000:0.0:1790391470.092013:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790391470.092023:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186469376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391470.092049:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391470.092129:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186469376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (3094us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391470.092136:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790391470.092187:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186469376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391471.002974:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391471.003022:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391471.003058:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391471.003079:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391471.003100:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391471.003118:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391471.003143:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391471.003178:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169642240 00000100:00100000:1.0:1790391471.003187:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169642240 00000100:00100000:1.0:1790391471.003249:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169642752 00000100:00100000:1.0:1790391471.003252:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169642752 00000100:00100000:1.0:1790391471.003270:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169642112 00000100:00100000:1.0:1790391471.003272:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169642112 00000100:00100000:1.0:1790391471.003284:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169642624 00000100:00100000:1.0:1790391471.003286:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169642624 00000100:00100000:1.0:1790391471.003300:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 345 00000100:00100000:1.0:1790391471.003309:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169642240:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391471.003633:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169641984 00000100:00100000:0.0:1790391471.003637:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169641984 00000100:00100000:0.0:1790391471.003681:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 395 00000100:00100000:0.0:1790391471.003688:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169641984:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391471.003867:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169642240:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 556us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391471.003901:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 345 00000100:00100000:1.0:1790391471.003920:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 346 00000100:00100000:1.0:1790391471.003927:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169642752:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391471.007440:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169642496 00000100:00100000:3.0:1790391471.007466:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169642496 00000100:00100000:3.0:1790391471.007544:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169642368 00000100:00100000:3.0:1790391471.007547:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169642368 00000100:00100000:3.0:1790391471.007575:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 173 00000100:00100000:3.0:1790391471.007585:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169642496:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391471.009864:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 174 00000100:00100000:2.0:1790391471.009983:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169642368:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391471.013722:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169641984:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 10022us (10744us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.013737:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 395 00000100:00080000:0.0:1790391471.016626:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391471.016635:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391471.016637:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391471.016640:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391471.019274:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 347 00000100:00100000:0.0:1790391471.019293:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:2383:x1877361169642112:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391471.019364:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:2383:x1877361169642112:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 80us (16263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.019372:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 347 00000100:00100000:0.0:1790391471.019399:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 348 00000100:00100000:0.0:1790391471.019406:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169642624:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391471.019435:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169642624:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 29us (16290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.019441:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 348 00000100:00100000:0.0:1790391471.019481:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2383:x1877361169642752:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 15554us (16401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.019487:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 346 00000100:00100000:3.0:1790391471.028113:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2383:x1877361169642496:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 20515us (25040us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391471.028128:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 173 00000100:00100000:2.0:1790391471.028198:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2383:x1877361169642368:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 18321us (25077us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391471.028207:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 174 00010000:00010000:1.0:1790391471.049698:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391471.115957:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186469504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391471.116037:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391471.116103:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391471.116127:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186469632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391471.116156:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391471.116190:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186469632 00000100:00100000:1.0:1790391471.116198:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186469632 00000100:00100000:1.0:1790391471.116244:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1790391471.116254:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186469632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391471.116289:0:7840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790391471.116330:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186469632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391471.116336:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1790391471.116379:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186469632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391471.116475:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186469504 00000100:00100000:0.0:1790391471.116485:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186469504 00000100:00100000:0.0:1790391471.116535:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790391471.116542:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186469504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391471.116563:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790391471.116599:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186469504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.116606:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1790391471.116664:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391471.116690:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186469504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391471.118567:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391471.118587:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186469760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391471.118647:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391471.118841:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186469760 00000100:00100000:0.0:1790391471.118850:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186469760 00000100:00100000:0.0:1790391471.118934:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790391471.118943:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186469760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391471.118962:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790391471.119001:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186469760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.119008:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1790391471.119070:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391471.119272:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1790391471.119278:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1790391471.119303:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186469760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391471.880460:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391471.880902:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169642880 00000100:00100000:0.0:1790391471.880915:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169642880 00000100:00100000:0.0:1790391471.880984:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 255 00000100:00100000:0.0:1790391471.880995:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:12149:x1877361169642880:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790391471.881094:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:12149:x1877361169642880:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 Request processed in 100us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.881102:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 255 00000100:00100000:2.0:1790391471.902391:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391471.902640:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169643008 00000100:00100000:0.0:1790391471.902721:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169643008 00000100:00100000:0.0:1790391471.902830:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 256 00000100:00100000:0.0:1790391471.902842:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:12149:x1877361169643008:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790391471.902981:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:12149:x1877361169643008:12345-192.168.202.28@tcp:60:lhsmtool_posix.0 Request processed in 142us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391471.902989:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 256 00000100:00100000:1.0:1790391471.912837:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391471.912946:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169643264 00000100:00100000:3.0:1790391471.912957:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169643264 00000100:00100000:3.0:1790391471.913022:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 65 00000100:00100000:3.0:1790391471.913034:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:12149:x1877361169643264:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790391471.913287:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:12149:x1877361169643264:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 253us (460us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1790391471.913295:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 65 00010000:00010000:1.0:1790391472.072124:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391472.216561:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391472.219824:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169643392 00000100:00100000:0.0:1790391472.219842:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169643392 00000100:00100000:0.0:1790391472.219974:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 257 00000100:00100000:0.0:1790391472.219985:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:12955:x1877361169643392:12345-192.168.202.28@tcp:101:lsof.0 00010000:00010000:0.0:1790391472.220015:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391472.220040:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e2020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b04cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391472.220131:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e2027 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391472.220146:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e2027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391472.220158:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e2027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391472.220208:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790391472.220213:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391472.220237:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e2027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391472.220264:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee200/0x2b1b7949f13e2020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04cd expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391472.220284:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e2027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04cd expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391472.220306:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b6ca00) 00010000:00010000:0.0:1790391472.220309:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391472.220313:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eeee00, rc 0) 00000100:00100000:0.0:1790391472.220385:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:12955:x1877361169643392:12345-192.168.202.28@tcp:101:lsof.0 Request processed in 402us (3834us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391472.220392:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 257 00010000:00010000:3.0:1790391473.096078:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391473.160179:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391473.160341:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186469888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391473.160413:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391473.160460:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186469888 00000100:00100000:2.0:1790391473.160470:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186469888 00000100:00100000:2.0:1790391473.160518:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790391473.160529:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186469888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391473.160564:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1790391473.160612:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186469888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391473.160620:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1790391473.160682:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186469888:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790391474.121261:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391474.249147:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790391474.697244:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186470272:0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.697313:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391474.697362:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186470784:0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.697388:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391474.697412:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186471296:0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.697433:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391474.697462:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790391474.697468:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186470400:0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.697499:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391474.697518:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186470912:0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.697541:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391474.697563:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186471424:0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.697582:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391474.697614:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186470272 00000100:00100000:3.0:1790391474.697634:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186470272 00000100:00100000:3.0:1790391474.697682:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1790391474.697690:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186470272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.697749:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186470272:12345-0@lo:400:kworker.0 Request processed in 58us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391474.697757:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1790391474.697779:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186470784 00000100:00100000:3.0:1790391474.697783:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186470784 00000100:00100000:3.0:1790391474.697826:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186471296 00000100:00100000:3.0:1790391474.697829:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186471296 00000100:00100000:2.0:1790391474.697841:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186470400 00000100:00100000:2.0:1790391474.697844:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186470400 00000100:00100000:3.0:1790391474.697846:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1790391474.697851:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186470784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391474.697862:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1790391474.697868:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186471296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.697901:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186470784:12345-0@lo:400:kworker.0 Request processed in 48us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391474.697908:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1790391474.697921:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1790391474.697926:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186470400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391474.697927:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186471296:12345-0@lo:400:kworker.0 Request processed in 58us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391474.697933:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1790391474.697952:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186470400:12345-0@lo:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391474.697958:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1790391474.698003:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186470912 00000100:00100000:3.0:1790391474.698007:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186470912 00000100:00100000:1.0:1790391474.698374:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186470016:0@lo:400:kworker.0 00000100:00100000:1.0:1790391474.698415:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391474.698443:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186470528:0@lo:400:kworker.0 00000100:00100000:1.0:1790391474.698475:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391474.698493:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186471040:0@lo:400:kworker.0 00000100:00100000:1.0:1790391474.698512:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391474.702465:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186470144:0@lo:400:kworker.0 00000100:00100000:1.0:1790391474.702523:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391474.702545:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186470656:0@lo:400:kworker.0 00000100:00100000:1.0:1790391474.702566:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391474.702582:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186471168:0@lo:400:kworker.0 00000100:00100000:1.0:1790391474.702601:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391474.703860:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186471552:0@lo:400:kworker.0 00000100:00100000:0.0:1790391474.703938:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790391474.704040:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391474.704047:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:1.0:1790391474.706903:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1790391474.706918:0:6491:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000100:00100000:3.0:1790391474.707085:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186471424 00000100:00100000:2.0:1790391474.707085:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186471040 00000100:00100000:3.0:1790391474.707097:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186471424 00000100:00100000:3.0:1790391474.707173:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1790391474.707183:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391474.707185:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186470912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391474.707216:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186471040 00000100:00100000:3.0:1790391474.707286:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186470912:12345-0@lo:400:kworker.0 Request processed in 105us (9744us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391474.707294:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790391474.707312:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790391474.707318:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186471424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.707346:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186471424:12345-0@lo:400:kworker.0 Request processed in 28us (9763us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391474.707351:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790391474.707376:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186470528 00000100:00100000:3.0:1790391474.707381:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186470528 00000100:00100000:3.0:1790391474.707405:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1790391474.707411:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186470528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.707442:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186470528:12345-0@lo:400:kworker.0 Request processed in 31us (8966us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391474.707448:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1790391474.707782:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186470400:0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.707801:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186470912:0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.707811:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186471424:0@lo:400:kworker.0 00000100:00100000:2.0:1790391474.707812:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186470016 00000100:00100000:2.0:1790391474.707816:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186470016 00000100:00100000:3.0:1790391474.707822:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186470272:0@lo:400:kworker.0 00000100:00100000:2.0:1790391474.707845:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00010000:00080000:3.0:1790391474.707848:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288346d80 x1877361186470784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391474.707852:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186470016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.707858:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186470784:0@lo:400:kworker.0 00010000:00080000:3.0:1790391474.707870:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288344a80 x1877361186471296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391474.707898:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186471296:0@lo:400:kworker.0 00000100:00100000:2.0:1790391474.707911:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186470016:12345-0@lo:400:kworker.0 Request processed in 60us (9496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391474.707917:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1790391474.707941:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186470144 00000100:00100000:3.0:1790391474.707946:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186470144 00000100:00100000:2.0:1790391474.707959:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186470656 00000100:00100000:2.0:1790391474.707963:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186470656 00000100:00100000:3.0:1790391474.707966:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186471168 00000100:00100000:3.0:1790391474.707969:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186471168 00000100:00100000:2.0:1790391474.707985:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1790391474.707991:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186470144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391474.708029:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877361186470144:12345-0@lo:400:kworker.0 Request processed in 37us (5505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391474.708035:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1790391474.708046:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1790391474.708052:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186470656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391474.708080:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186470656:12345-0@lo:400:kworker.0 Request processed in 29us (5514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391474.708087:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00080000:2.0:1790391474.708112:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391474.708134:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877361186470144:0@lo:400:kworker.0 00000100:00100000:2.0:1790391474.708146:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186470656:0@lo:400:kworker.0 00000100:00080000:2.0:1790391474.708171:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391474.708195:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790391474.708201:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186471040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391474.708237:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186471040:12345-0@lo:400:kworker.0 Request processed in 36us (9723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391474.708243:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790391474.709408:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1790391474.709419:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186471168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.709484:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186471168:12345-0@lo:400:kworker.0 Request processed in 67us (6881us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391474.709491:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1790391474.709539:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186471168:0@lo:400:kworker.0 00000020:00080000:0.0:1790391474.712103:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1790391474.712120:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1790391474.712193:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186470016:0@lo:400:kworker.0 00000100:00100000:0.0:1790391474.712224:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186470528:0@lo:400:kworker.0 00000100:00100000:0.0:1790391474.712237:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186471040:0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.715337:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186471552 00000100:00100000:3.0:1790391474.715350:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186471552 00000100:00080000:2.0:1790391474.715472:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391474.716308:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790391474.716321:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186471552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391474.716417:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186471552:12345-0@lo:400:kworker.0 Request processed in 99us (12478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391474.716424:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790391474.716965:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186471552:0@lo:400:kworker.0 00000040:00080000:1.0:1790391474.762776:0:13791:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391474.762783:0:13791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391474.762902:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1790391474.762910:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:2.0:1790391475.052735:0:15003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:57:54 (1790391474) 00010000:00010000:1.0:1790391475.144765:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391475.208169:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186471680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391475.208254:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391475.208364:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186471680 00000100:00100000:0.0:1790391475.208372:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186471680 00000100:00100000:0.0:1790391475.208415:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790391475.208422:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186471680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391475.208447:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790391475.208483:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186471680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391475.208488:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790391475.208568:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391475.208576:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186471808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391475.208595:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391475.208613:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186471808 00000100:00100000:3.0:1790391475.208615:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186471808 00000100:00100000:3.0:1790391475.208646:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790391475.208650:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186471808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790391475.208657:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391475.208677:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186471808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 27us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391475.208681:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790391475.208720:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186471808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391475.208795:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186471680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391476.105084:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391476.107493:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391476.107528:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391476.107556:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391476.107579:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391476.107598:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391476.107634:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391476.107681:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169644032 00000100:00100000:1.0:1790391476.107691:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169644032 00000100:00100000:1.0:1790391476.107744:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169643904 00000100:00100000:1.0:1790391476.107747:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169643904 00000100:00100000:1.0:1790391476.107772:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 179 00000100:00100000:1.0:1790391476.107782:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169644032:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391476.107852:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169644032:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 72us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391476.107859:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 179 00000100:00100000:1.0:1790391476.107873:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 180 00000100:00100000:1.0:1790391476.107896:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169643904:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391476.107921:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2384:x1877361169643904:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391476.107927:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 180 00000100:00100000:1.0:1790391476.107945:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169643776 00000100:00100000:1.0:1790391476.107949:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169643776 00000100:00100000:1.0:1790391476.107969:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169644288 00000100:00100000:1.0:1790391476.107971:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169644288 00000100:00100000:1.0:1790391476.107980:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169643648 00000100:00100000:1.0:1790391476.107982:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169643648 00000100:00100000:1.0:1790391476.107992:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169644160 00000100:00100000:1.0:1790391476.107994:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169644160 00000100:00100000:1.0:1790391476.108006:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 355 00000100:00100000:1.0:1790391476.108012:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169643776:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391476.108038:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2384:x1877361169643776:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391476.108044:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 355 00000100:00100000:1.0:1790391476.108063:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 356 00000100:00100000:1.0:1790391476.108069:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169644288:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391476.108091:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2384:x1877361169644288:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 22us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391476.108097:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 356 00000100:00100000:1.0:1790391476.108107:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 357 00000100:00100000:1.0:1790391476.108112:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:2384:x1877361169643648:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391476.108134:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:2384:x1877361169643648:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 23us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391476.108140:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 357 00000100:00100000:1.0:1790391476.108149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 358 00000100:00100000:1.0:1790391476.108154:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2384:x1877361169644160:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391476.108172:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2384:x1877361169644160:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 18us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391476.108177:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 358 00000100:00080000:2.0:1790391476.108373:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790391476.108378:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391476.108381:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391476.108382:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391476.113709:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169643520 00000100:00100000:3.0:1790391476.113723:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169643520 00000100:00100000:3.0:1790391476.113787:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 397 00000100:00100000:3.0:1790391476.113798:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169643520:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391476.115891:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2384:x1877361169643520:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 2074us (10797us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391476.115908:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 397 00010000:00010000:1.0:1790391476.168091:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391476.232269:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391476.232296:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186471936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391476.232375:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391476.232454:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186471936 00000100:00100000:1.0:1790391476.232462:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186471936 00000100:00100000:1.0:1790391476.232525:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790391476.232534:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186471936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790391476.232564:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1790391476.232633:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186471936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391476.232653:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790391476.232715:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186471936:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790391476.232740:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391476.232932:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186472064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391476.232963:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391476.233292:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186472064 00000100:00100000:2.0:1790391476.233298:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186472064 00000100:00100000:2.0:1790391476.233342:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1790391476.233350:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186472064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391476.233375:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790391476.233427:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186472064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391476.233444:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1790391476.233470:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186472064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391476.233788:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391476.233840:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186472192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391476.233872:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391476.234048:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186472192 00000100:00100000:2.0:1790391476.234053:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186472192 00000100:00100000:2.0:1790391476.234128:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790391476.234136:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186472192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391476.234151:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790391476.234232:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186472192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391476.234239:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790391476.234308:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186472192:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790391476.234936:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790391477.192059:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391478.216036:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391478.271125:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391478.279043:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169644544 00000100:00100000:3.0:1790391478.279061:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169644544 00000100:00100000:3.0:1790391478.279149:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:3.0:1790391478.279162:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+18:13178:x1877361169644544:12345-192.168.202.28@tcp:35:umount.0 00000100:00080000:1.0:1790391478.279399:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790391478.280611:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:13178:x1877361169644544:12345-192.168.202.28@tcp:35:umount.0 Request processed in 1445us (9487us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1790391478.280632:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 66 00000100:00100000:3.0:1790391478.291102:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391478.291127:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186472320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790391478.291205:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391478.291336:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186472320 00000100:00100000:2.0:1790391478.291344:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186472320 00000100:00100000:2.0:1790391478.291406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1790391478.291415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186472320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391478.291455:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1790391478.291501:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186472320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391478.291508:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1790391478.291834:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186472320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391478.304529:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391478.304646:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169644800 00000100:00100000:2.0:1790391478.304658:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169644800 00000100:00100000:2.0:1790391478.304717:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:2.0:1790391478.304727:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+19:13178:x1877361169644800:12345-192.168.202.28@tcp:35:umount.0 00000100:00100000:2.0:1790391478.305064:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:13178:x1877361169644800:12345-192.168.202.28@tcp:35:umount.0 Request processed in 337us (544us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1790391478.305073:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 67 00000100:00100000:1.0:1790391478.312416:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391478.312550:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169645056 00000100:00100000:2.0:1790391478.312560:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169645056 00000100:00100000:2.0:1790391478.312619:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:2.0:1790391478.312630:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5290b6e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+20:13178:x1877361169645056:12345-192.168.202.28@tcp:35:umount.0 00000100:00100000:2.0:1790391478.312846:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5290b6e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:13178:x1877361169645056:12345-192.168.202.28@tcp:35:umount.0 Request processed in 217us (438us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1790391478.312853:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 68 00000100:00100000:1.0:1790391478.323204:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391478.323330:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169645312 00000100:00100000:2.0:1790391478.323339:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169645312 00000100:00100000:2.0:1790391478.323392:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 69 00000100:00100000:2.0:1790391478.323402:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:13178:x1877361169645312:12345-192.168.202.28@tcp:35:umount.0 00000100:00100000:2.0:1790391478.323680:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5181cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:13178:x1877361169645312:12345-192.168.202.28@tcp:35:umount.0 Request processed in 278us (485us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1790391478.323700:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 69 00000100:00100000:0.0:1790391478.342294:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391478.342339:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391478.342375:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391478.342636:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169645440 00000100:00100000:1.0:1790391478.342647:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169645440 00000100:00100000:1.0:1790391478.342702:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169645696 00000100:00100000:1.0:1790391478.342705:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169645696 00000100:00100000:1.0:1790391478.342715:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169645568 00000100:00100000:1.0:1790391478.342717:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169645568 00000100:00100000:1.0:1790391478.342730:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:1.0:1790391478.342738:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+15:2383:x1877361169645440:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391478.342752:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391478.342770:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144200/0x2b1b7949f13e0f9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0020 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.342789:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391478.342843:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+14:2383:x1877361169645440:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 106us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391478.342870:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:1.0:1790391478.342933:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391478.342939:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+13:2383:x1877361169645696:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391478.342951:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391478.342960:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309c400/0x2b1b7949f13e1251 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00f9 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.342969:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391478.342984:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+12:2383:x1877361169645696:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 46us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391478.342990:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391478.342999:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:1.0:1790391478.343005:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:2383:x1877361169645568:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391478.343018:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391478.343025:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f6800/0x2b1b7949f13e0f41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49affe1 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.343038:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391478.343051:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+10:2383:x1877361169645568:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 46us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391478.343056:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:0.0:1790391478.343376:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391478.343432:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169645824 00000100:00100000:2.0:1790391478.343437:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169645824 00000100:00100000:2.0:1790391478.343481:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 80 00000100:00100000:2.0:1790391478.343488:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2380:x1877361169645824:12345-192.168.202.28@tcp:9:umount.0 00000020:00000080:2.0:1790391478.343519:0:10505:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e131c 00000100:00080000:2.0:1790391478.343534:0:10505:0:(import.c:65:import_set_state_nolock()) ffff9e5183a15000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391478.343581:0:10505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1790391478.343740:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+2:2380:x1877361169645824:12345-192.168.202.28@tcp:9:umount.0 Request processed in 253us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391478.343753:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 80 00000100:00080000:0.0:1790391478.343809:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790391478.344456:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391478.364685:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391478.364817:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169646208 00000100:00100000:1.0:1790391478.364828:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169646208 00000100:00100000:1.0:1790391478.364918:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 81 00000100:00080000:0.0:1790391478.365004:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391478.365039:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+7:2380:x1877361169646208:12345-192.168.202.28@tcp:9:umount.0 00000020:00000080:1.0:1790391478.365081:0:9796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e1592 00000020:00010000:1.0:1790391478.365088:0:9796:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5287d5c000: total 0 00000100:00080000:1.0:1790391478.365092:0:9796:0:(import.c:65:import_set_state_nolock()) ffff9e5287d58800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391478.365140:0:9796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:0.0:1790391478.365247:0:13725:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5287d5c000: total 0 00010000:00010000:0.0:1790391478.365294:0:13725:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5287d5c000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1790391478.365350:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9da2439/0x2b1b7949f13e2019 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04c6 expref: 6 pid: 9796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391478.365388:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000276f9c44/0x2b1b7949f13e194a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02e3 expref: 5 pid: 10505 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391478.365401:0:13725:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5287d5c000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1790391478.365414:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391478.365416:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391478.365418:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391478.365563:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+2:2380:x1877361169646208:12345-192.168.202.28@tcp:9:umount.0 Request processed in 635us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391478.365571:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 81 00000100:00100000:1.0:1790391478.382432:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391478.382545:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169647232 00000100:00100000:2.0:1790391478.382555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169647232 00000100:00100000:2.0:1790391478.382652:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 258 00000100:00100000:2.0:1790391478.382663:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+22:2380:x1877361169647232:12345-192.168.202.28@tcp:39:umount.0 00000020:00000080:2.0:1790391478.382694:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0f4f 00000020:00010000:2.0:1790391478.382711:0:6512:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5183837000: total 0 00000100:00080000:2.0:1790391478.382716:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9e5183834800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391478.382748:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1790391478.382922:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+21:2380:x1877361169647232:12345-192.168.202.28@tcp:39:umount.0 Request processed in 260us (497us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1790391478.382930:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 258 00000020:00010000:1.0:1790391478.383358:0:13724:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5183837000: total 0 00010000:00010000:1.0:1790391478.383408:0:13724:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5183837000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790391478.383442:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b6ca00) 00010000:00010000:1.0:1790391478.383447:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391478.383455:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d000/0x2b1b7949f13e19b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ff expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383474:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:1.0:1790391478.383477:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790391478.383481:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ce00/0x2b1b7949f13e12f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0123 expref: 19 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383494:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391478.383497:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391478.383501:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee400/0x2b1b7949f13e190b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02ce expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383513:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:1.0:1790391478.383516:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790391478.383534:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eef200/0x2b1b7949f13e1cbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b03df expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383550:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e52b9b6c300) 00010000:00010000:1.0:1790391478.383552:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790391478.383556:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b763ca00/0x2b1b7949f13e15ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b01fc expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383575:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e52b5d77000) 00010000:00010000:1.0:1790391478.383577:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391478.383581:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e1297 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b010e expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383609:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:1.0:1790391478.383612:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391478.383616:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055200/0x2b1b7949f13e1efa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0479 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383628:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391478.383630:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790391478.383634:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e1935 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b02dc expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383647:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:1.0:1790391478.383650:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790391478.383653:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eee600/0x2b1b7949f13e19cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0306 expref: 12 pid: 10091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383668:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391478.383677:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790391478.383682:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086200/0x2b1b7949f13e182b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0296 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383699:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:1.0:1790391478.383701:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790391478.383705:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e2004 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04bf expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383717:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e52b5d77e00) 00010000:00010000:1.0:1790391478.383720:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391478.383724:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e127b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0107 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383739:0:13724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e5182c85e00) 00010000:00010000:1.0:1790391478.383741:0:13724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391478.383746:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087000/0x2b1b7949f13e1fda lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04b1 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391478.383759:0:13724:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5183837000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1790391478.383773:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391478.383775:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391478.383777:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391478.407979:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391478.408056:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169647360 00000100:00100000:3.0:1790391478.408068:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169647360 00000100:00100000:3.0:1790391478.408139:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 259 00000100:00100000:3.0:1790391478.408149:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+5:2380:x1877361169647360:12345-192.168.202.28@tcp:39:umount.0 00000020:00000080:3.0:1790391478.408194:0:10091:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0f56 00000100:00080000:3.0:1790391478.408213:0:10091:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1790391478.408380:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:3.0:1790391478.409304:0:10091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790391478.409487:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70c6d8ed-6335-49ea-b8ad-c4d19ba2541d+3:2380:x1877361169647360:12345-192.168.202.28@tcp:39:umount.0 Request processed in 1336us (1515us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790391478.409496:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 259 00010000:00010000:2.0:1790391478.411603:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391479.241210:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391479.816219:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186472576:0@lo:400:kworker.0 00000100:00100000:0.0:1790391479.816282:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391479.816384:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391479.816398:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186472448:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.816435:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391479.816487:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186472448 00000100:00100000:1.0:1790391479.816495:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186472448 00000100:00100000:1.0:1790391479.816552:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1790391479.816561:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186472448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.816620:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3637:x1877361186472448:12345-0@lo:400:kworker.0 Request processed in 60us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.816627:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1790391479.816673:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186472448:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.816785:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186472704:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.816818:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391479.816846:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186472704 00000100:00100000:1.0:1790391479.816851:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186472704 00000100:00100000:1.0:1790391479.816902:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790391479.816910:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186472704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.816956:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186472704:12345-0@lo:400:kworker.0 Request processed in 47us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.816962:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790391479.816987:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186472704:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.817011:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186472576 00000100:00100000:1.0:1790391479.817015:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186472576 00000100:00100000:1.0:1790391479.817043:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1790391479.817049:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186472576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.823236:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186472960:0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.823327:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391479.823362:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186473472:0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.823386:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391479.823404:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186473984:0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.823422:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391479.823444:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790391479.823450:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186472832:0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.823474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391479.823492:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186473344:0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.823510:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391479.823526:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186473856:0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.823546:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391479.823587:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186473472 00000100:00100000:2.0:1790391479.823594:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186473472 00000100:00100000:2.0:1790391479.823644:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186473984 00000100:00100000:2.0:1790391479.823648:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186473984 00000100:00100000:2.0:1790391479.823663:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186473344 00000100:00100000:2.0:1790391479.823666:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186473344 00000100:00100000:2.0:1790391479.823679:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186473856 00000100:00100000:2.0:1790391479.823682:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186473856 00000100:00100000:2.0:1790391479.823696:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790391479.823703:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186473472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.823755:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186473472:12345-0@lo:400:kworker.0 Request processed in 52us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391479.823762:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790391479.823778:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790391479.823785:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186473984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.823819:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186473984:12345-0@lo:400:kworker.0 Request processed in 35us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391479.823825:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790391479.823838:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790391479.823844:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186473344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.823869:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186473344:12345-0@lo:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391479.823903:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790391479.824391:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186472576:12345-0@lo:400:kworker.0 Request processed in 7340us (8107us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.824401:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1790391479.824425:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186473216:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.824456:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391479.824486:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186473728:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.824507:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391479.824526:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790391479.824531:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186473088:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.824551:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391479.824561:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186473600:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.824593:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391479.824612:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186472832 00000100:00100000:1.0:1790391479.824616:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186472832 00000100:00100000:1.0:1790391479.824635:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186473216 00000100:00100000:1.0:1790391479.824638:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186473216 00000100:00100000:1.0:1790391479.824650:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186473728 00000100:00100000:1.0:1790391479.824653:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186473728 00000100:00100000:1.0:1790391479.824664:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186473088 00000100:00100000:1.0:1790391479.824666:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186473088 00000100:00100000:1.0:1790391479.824677:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186473600 00000100:00100000:1.0:1790391479.824679:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186473600 00000100:00100000:1.0:1790391479.824692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1790391479.824698:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186472832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.824728:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186472832:12345-0@lo:400:kworker.0 Request processed in 30us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.824734:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1790391479.824745:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1790391479.824751:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186473216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.824781:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186473216:12345-0@lo:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.824787:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00010000:00080000:1.0:1790391479.824817:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b7e300 x1877361186473216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391479.824838:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186473216:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.824862:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1790391479.824869:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186473728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.824930:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186473728:12345-0@lo:400:kworker.0 Request processed in 49us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.824937:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00010000:00080000:1.0:1790391479.824960:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e51838f4a80 x1877361186473728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391479.824969:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186473728:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.824986:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1790391479.824993:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186473088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.825023:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186473088:12345-0@lo:400:kworker.0 Request processed in 31us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.825029:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1790391479.825049:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186473088:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.825065:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1790391479.825072:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186473600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.825100:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186473600:12345-0@lo:400:kworker.0 Request processed in 30us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.825106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1790391479.825126:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186473600:0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.825170:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186472960 00000100:00100000:1.0:1790391479.825180:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186472960 00000100:00100000:1.0:1790391479.825207:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1790391479.825213:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186472960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391479.825246:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186472960:12345-0@lo:400:kworker.0 Request processed in 33us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.825252:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1790391479.825367:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790391479.825377:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.825410:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186473856:12345-0@lo:400:kworker.0 Request processed in 35us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391479.826063:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186472576:0@lo:400:kworker.0 00000100:00080000:0.0:1790391479.826103:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391479.826108:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391479.826110:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790391479.826113:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391479.826153:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186472832:0@lo:400:kworker.0 00000100:00100000:0.0:1790391479.826174:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186473344:0@lo:400:kworker.0 00000100:00100000:0.0:1790391479.826184:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186473856:0@lo:400:kworker.0 00000100:00100000:0.0:1790391479.826193:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186472960:0@lo:400:kworker.0 00000100:00100000:0.0:1790391479.826202:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186473472:0@lo:400:kworker.0 00000100:00100000:0.0:1790391479.826213:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186473984:0@lo:400:kworker.0 00000100:00100000:2.0:1790391479.838835:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790391479.950047:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391479.950117:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391479.950338:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169647488 00000100:00100000:1.0:1790391479.950349:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169647488 00000100:00100000:1.0:1790391479.950429:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169647616 00000100:00100000:1.0:1790391479.950433:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169647616 00000100:00100000:1.0:1790391479.950460:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:0.0:1790391479.950469:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:1.0:1790391479.950473:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:2381:x1877361169647488:12345-192.168.202.28@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790391479.950485:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6dba3-950e-4d6c-8a57-84db940a8db9+11:2382:x1877361169647616:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391479.950492:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391479.950496:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391479.950513:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309d600/0x2b1b7949f13e124a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b00f2 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391479.950515:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e1052 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0035 expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391479.950544:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391479.950545:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391479.950615:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+9:2381:x1877361169647488:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 146us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.950622:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:0.0:1790391479.955020:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:2382:x1877361169647616:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 4525us (4887us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391479.955039:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:2.0:1790391479.957841:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391479.958029:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391479.958818:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169648000 00000100:00100000:3.0:1790391479.958830:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169648000 00000100:00100000:3.0:1790391479.958930:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 260 00000100:00100000:3.0:1790391479.958941:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+6:2380:x1877361169648000:12345-192.168.202.28@tcp:39:umount.0 00000020:00000080:3.0:1790391479.958980:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e1067 00000020:00010000:3.0:1790391479.958999:0:6512:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5181cc3800: total 0 00000100:00080000:3.0:1790391479.959004:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9e5181cc1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790391479.959054:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:0.0:1790391479.959523:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1790391479.959534:0:13725:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5181cc3800: total 0 00010000:00010000:0.0:1790391479.959603:0:13725:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5181cc3800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790391479.959640:0:13725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e52b9b6ca00) 00010000:00010000:0.0:1790391479.959644:0:13725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391479.959653:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52b5eeee00/0x2b1b7949f13e2027 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04cd expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391479.959676:0:13725:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5181cc3800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1790391479.959697:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391479.959699:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391479.959701:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391479.960532:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169647872 00000100:00100000:1.0:1790391479.960541:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169647872 00000100:00100000:1.0:1790391479.960600:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:1.0:1790391479.960609:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+8:2384:x1877361169647872:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391479.960623:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391479.960634:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309c000/0x2b1b7949f13e1059 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0066 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391479.960658:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391479.960708:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70c6dba3-950e-4d6c-8a57-84db940a8db9+7:2384:x1877361169647872:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 100us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391479.960715:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:3.0:1790391479.963510:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b4e828e-5852-4c32-bc74-22a6cf01e473+3:2380:x1877361169648000:12345-192.168.202.28@tcp:39:umount.0 Request processed in 4560us (5470us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1790391479.963526:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 260 00000001:00080000:1.0:1790391479.965501:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000001:00100000:1.0:1790391479.965514:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000001:00080000:1.0:1790391479.965519:0:6491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1790391479.965526:0:6491:0:(genops.c:885:class_export_put()) final put ffff9e5183837000/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:2.0:1790391479.965605:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183837000/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d for lustre-MDT0000 00000020:00000080:2.0:1790391479.965676:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5183834800 for lustre-MDT0000 00000100:00100000:2.0:1790391479.972599:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391479.972683:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169648128 00000100:00100000:1.0:1790391479.972692:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169648128 00000100:00100000:1.0:1790391479.972765:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 261 00000100:00100000:1.0:1790391479.972774:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+5:2380:x1877361169648128:12345-192.168.202.28@tcp:39:umount.0 00000020:00000080:1.0:1790391479.972811:0:10091:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e106e 00000100:00080000:1.0:1790391479.972819:0:10091:0:(import.c:65:import_set_state_nolock()) ffff9e5181cc5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790391479.972845:0:10091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1790391479.972926:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391479.973028:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b4e828e-5852-4c32-bc74-22a6cf01e473+3:2380:x1877361169648128:12345-192.168.202.28@tcp:39:umount.0 Request processed in 255us (440us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790391479.973034:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 261 00000100:00080000:0.0:1790391479.973115:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391480.020873:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391480.021018:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169648384 00000100:00100000:2.0:1790391480.021029:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169648384 00000100:00100000:2.0:1790391480.021092:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 399 00000100:00100000:2.0:1790391480.021103:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+7:2380:x1877361169648384:12345-192.168.202.28@tcp:251:umount.0 00000020:00000080:2.0:1790391480.021149:0:6506:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0f2c 00000020:00010000:2.0:1790391480.021157:0:6506:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e5182f5e800: total 0 00000100:00080000:2.0:1790391480.021174:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5e000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790391480.021265:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70c6dba3-950e-4d6c-8a57-84db940a8db9+3:2380:x1877361169648384:12345-192.168.202.28@tcp:251:umount.0 Request processed in 163us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391480.021274:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 399 00000020:00010000:3.0:1790391480.021307:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e5182f5e800: total 0 00010000:00010000:3.0:1790391480.021312:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391480.021369:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e5182f5e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790391480.021404:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f7c00/0x2b1b7949f13e1005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0027 expref: 2 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391480.021419:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e5182f5e800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1790391480.021430:0:6501:0:(genops.c:885:class_export_put()) final put ffff9e5182f5e800/70c6dba3-950e-4d6c-8a57-84db940a8db9 00010000:00010000:3.0:1790391480.021449:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391480.021451:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391480.021453:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790391480.021657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182f5e800/70c6dba3-950e-4d6c-8a57-84db940a8db9 for MGS 00000020:00000080:2.0:1790391480.021697:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182f5e000 for MGS 00010000:00010000:0.0:1790391480.264135:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391480.328202:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186474112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391480.328271:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391480.328345:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186474112 00000100:00100000:3.0:1790391480.328353:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186474112 00000100:00100000:3.0:1790391480.328397:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790391480.328405:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186474112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790391480.328432:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391480.328475:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186474112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391480.328482:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790391480.328552:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186474112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391480.329446:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186474240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391480.329487:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391480.332545:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186474240 00000100:00100000:0.0:1790391480.332559:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186474240 00000100:00100000:1.0:1790391480.332995:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790391480.333006:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186474240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391480.333037:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391480.333123:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186474240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (3635us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391480.333129:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790391480.333326:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186474240:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790391481.288579:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391481.352139:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186474368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391481.352219:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391481.352364:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186474368 00000100:00100000:0.0:1790391481.352372:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186474368 00000100:00100000:0.0:1790391481.352425:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790391481.352434:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186474368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391481.352458:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790391481.352501:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186474368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391481.352508:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790391481.352545:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186474368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790391481.352653:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391481.352999:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391481.353008:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186474496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391481.353043:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391481.353121:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186474496 00000100:00100000:0.0:1790391481.353125:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186474496 00000100:00100000:0.0:1790391481.353165:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790391481.353171:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186474496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391481.353180:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790391481.353213:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186474496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391481.353219:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790391481.353254:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186474496:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790391481.353407:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391481.355351:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391481.355370:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186474624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391481.355428:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391481.355470:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186474624 00000100:00100000:2.0:1790391481.355476:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186474624 00000100:00100000:2.0:1790391481.355518:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790391481.355526:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186474624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391481.355558:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790391481.355615:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186474624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391481.355622:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790391481.355663:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186474624:0@lo:41:osp-pre-1-0.0 00000020:01000004:1.0:1790391481.639841:0:15199:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1790391481.660990:0:15199:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1790391481.661035:0:15199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.661045:0:15199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.661050:0:15199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.661054:0:15199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.661069:0:15199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790391481.661073:0:15199:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790391481.661093:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790391481.661097:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790391481.661101:0:15199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790391481.661121:0:15199:0:(import.c:65:import_set_state_nolock()) ffff9e5284980800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790391481.661227:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186474752:0@lo:39:umount.0 00000100:00100000:0.0:1790391481.661291:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391481.661416:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186474752 00000100:00100000:3.0:1790391481.661423:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186474752 00000100:00100000:3.0:1790391481.661499:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1790391481.661509:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1877361186474752:12345-0@lo:39:umount.0 00000020:00000080:3.0:1790391481.661534:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0b43 00010000:00010000:1.0:1790391481.661539:0:13724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1790391481.661542:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9e52afc92000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790391481.661547:0:13724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.661554:0:13724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391481.661570:0:13724:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.661580:0:13724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391481.661586:0:13724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391481.661591:0:13724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391481.661594:0:13724:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790391481.661596:0:13724:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790391481.661620:0:13724:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.661626:0:13724:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790391481.661627:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1877361186474752:12345-0@lo:39:umount.0 Request processed in 119us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391481.661634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1790391481.661643:0:6514:0:(genops.c:885:class_export_put()) final put ffff9e52b5cba800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1790391481.661643:0:13724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.661660:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295145600/0x2b1b7949f13e0fdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0fe2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391481.661680:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1790391481.661683:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391481.661691:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186474880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391481.661721:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790391481.661775:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5284980800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790391481.661785:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186474752:0@lo:39:umount.0 00010000:00010000:1.0:1790391481.661830:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391481.661832:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391481.661834:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391481.661846:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186474880 00000100:00100000:2.0:1790391481.661850:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186474880 00000100:00100000:2.0:1790391481.661906:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391481.661914:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3639:x1877361186474880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391481.661925:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391481.661940:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f7800/0x2b1b7949f13e0fe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0fdb expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391481.661962:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391481.661998:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:3639:x1877361186474880:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391481.662004:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391481.662216:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186474880:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1790391481.662357:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cba800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790391481.662502:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52afc92000 for lustre-MDT0000 00000100:00080000:3.0:1790391481.662515:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790391481.662518:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790391481.662522:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790391481.663518:0:15199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.663533:0:15199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.663540:0:15199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.663547:0:15199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.663641:0:15199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391481.663650:0:15199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.663657:0:15199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.663663:0:15199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.663686:0:15199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.663715:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391481.663722:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.663728:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f7400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391481.663731:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.663740:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391481.663747:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391481.663752:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790391481.663755:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1790391481.663784:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.663790:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391481.664116:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.664125:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7400/0x2b1b7949f13e0fe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0ff0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.664204:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391481.664209:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.664215:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eeea00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391481.664218:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.664226:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391481.664232:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391481.664237:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790391481.664239:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1790391481.664255:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.664261:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391481.664267:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391481.664275:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391481.664276:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391481.664284:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391481.664401:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186475136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391481.664462:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391481.664515:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391481.664521:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186475008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391481.664542:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391481.665234:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186475136 00000100:00100000:0.0:1790391481.665243:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186475136 00000100:00100000:0.0:1790391481.665299:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186475008 00000100:00100000:0.0:1790391481.665303:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186475008 00000100:00100000:0.0:1790391481.665327:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391481.665336:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+24:3638:x1877361186475136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391481.665349:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391481.665363:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566c600/0x2b1b7949f13e0eed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0ee6 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391481.665366:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790391481.665376:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:3638:x1877361186475008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391481.665377:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391481.665384:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391481.665392:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eee800/0x2b1b7949f13e0ff0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0fe9 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.665401:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391481.665461:0:15199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790391481.665468:0:15199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eeea00/0x2b1b7949f13e0ee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0eed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391481.665478:0:15199:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790391481.665499:0:15199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.665506:0:15199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.665512:0:15199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.665517:0:15199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.665529:0:15199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391481.665534:0:15199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.665540:0:15199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.665545:0:15199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.665570:0:15199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391481.665583:0:15199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790391481.665586:0:15199:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1790391481.665589:0:15199:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1790391481.665624:0:15199:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1790391481.665628:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1790391481.665632:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391481.665637:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:3.0:1790391481.665642:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e52b77e6800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790391481.665648:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e5181cc2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790391481.665652:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e52b608e000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790391481.665656:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e52b9932800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1790391481.665663:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9e5181cc3800 6b4e828e-5852-4c32-bc74-22a6cf01e473 192.168.202.28@tcp 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967528 stale:0 00000020:00080000:3.0:1790391481.665667:0:15199:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9e52ae8cb380) has exports, disconnecting them 00000020:00080000:3.0:1790391481.665671:0:15199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e52b77e6800), last request at 1790391479 00000020:00000080:3.0:1790391481.665677:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0e53 00000100:00080000:3.0:1790391481.665690:0:15199:0:(import.c:65:import_set_state_nolock()) ffff9e52b77e7800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790391481.665700:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:3638:x1877361186475008:12345-0@lo:103:ldlm_bl.0 Request processed in 326us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391481.665707:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00080000:3.0:1790391481.665727:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e52b77e6800): rc 0 00000020:00000080:3.0:1790391481.665730:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52b77e6800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1790391481.665738:0:15199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e5181cc2000), last request at 1790391479 00000020:00000080:3.0:1790391481.665741:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0d2d 00000100:00080000:3.0:1790391481.665746:0:15199:0:(import.c:65:import_set_state_nolock()) ffff9e5181cc4800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1790391481.665755:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b77e6800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790391481.665790:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b77e7800 for lustre-MDT0000 00000020:00080000:3.0:1790391481.665808:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5181cc2000): rc 0 00000020:00000080:3.0:1790391481.665811:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5181cc2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1790391481.665817:0:15199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e52b608e000), last request at 1790391247 00000020:00000080:3.0:1790391481.665821:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0c2a 00000100:00080000:3.0:1790391481.665825:0:15199:0:(import.c:65:import_set_state_nolock()) ffff9e52b608b000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1790391481.665833:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181cc2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1790391481.665843:0:13724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391481.665848:0:13724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1790391481.665854:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5181cc4800 for lustre-MDT0000 00010000:00010000:1.0:1790391481.665855:0:13724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087a00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391481.665858:0:13724:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790391481.665862:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e52b608e000): rc 0 00000020:00000080:3.0:1790391481.665864:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52b608e000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1790391481.665866:0:13724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790391481.665870:0:15199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e52b9932800), last request at 1790391247 00000020:00000080:3.0:1790391481.665873:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0bf9 00000100:00080000:3.0:1790391481.665896:0:15199:0:(import.c:65:import_set_state_nolock()) ffff9e52b9a89800 : changing import state from FULL to CLOSED 10000000:00010000:1.0:1790391481.665897:0:13724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391481.665903:0:13724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00000080:3.0:1790391481.665904:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b608e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 10000000:01000000:1.0:1790391481.665906:0:13724:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790391481.665908:0:13724:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790391481.665928:0:13724:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.665934:0:13724:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391481.665950:0:13724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.665957:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5183087a00/0x2b1b7949f13e123c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e1243 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1790391481.665962:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b608b000 for lustre-MDT0000 00010000:00010000:1.0:1790391481.665966:0:13724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391481.665970:0:13724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1790391481.665972:0:15199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:1.0:1790391481.665976:0:13724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566c000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391481.665978:0:13724:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.665984:0:13724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391481.665990:0:13724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391481.666005:0:13724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391481.666007:0:13724:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1790391481.666009:0:13724:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1790391481.666022:0:13724:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.666027:0:13724:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391481.666033:0:13724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790391481.666039:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e52b9932800): rc 0 00010000:00010000:1.0:1790391481.666040:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566c000/0x2b1b7949f13e0aa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0aa9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:3.0:1790391481.666045:0:15199:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffab8401843ae0 00000100:00080000:3.0:1790391481.666062:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790391481.666065:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1790391481.666143:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391481.666146:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391481.666147:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391481.666162:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186475392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391481.666198:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391481.666229:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391481.666235:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186475264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391481.666252:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391481.666272:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186475392 00000100:00100000:1.0:1790391481.666277:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186475392 00000100:00100000:1.0:1790391481.666297:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186475264 00000100:00100000:1.0:1790391481.666299:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186475264 00000100:00100000:1.0:1790391481.666310:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790391481.666316:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+23:3640:x1877361186475392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391481.666325:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391481.666340:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5280031e00/0x2b1b7949f13e0aa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0aa2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.666350:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391481.666438:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+22:3640:x1877361186475392:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391481.666445:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790391481.666457:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790391481.666462:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+21:3640:x1877361186475264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391481.666469:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391481.666477:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309d400/0x2b1b7949f13e1243 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e123c expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391481.666485:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391481.666503:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+20:3640:x1877361186475264:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391481.666508:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790391481.666538:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186475264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391481.666545:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186475392:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790391481.666843:0:15199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790391481.666855:0:15199:0:(import.c:65:import_set_state_nolock()) ffff9e52b7482800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790391481.666912:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186475520:0@lo:39:umount.0 00000100:00100000:1.0:1790391481.666943:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391481.667001:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391481.667428:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186475520 00000100:00100000:3.0:1790391481.667433:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186475520 00000100:00100000:3.0:1790391481.667464:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1790391481.667468:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1877361186475520:12345-0@lo:39:umount.0 00000020:00000080:3.0:1790391481.667487:0:7840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0c85 00000100:00080000:3.0:1790391481.667491:0:7840:0:(import.c:65:import_set_state_nolock()) ffff9e52b60a0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790391481.667508:0:7840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1790391481.667521:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391481.667658:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3636:x1877361186475520:12345-0@lo:39:umount.0 Request processed in 188us (713us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790391481.667664:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:1.0:1790391481.668071:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b7482800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790391481.668079:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186475520:0@lo:39:umount.0 00000100:00100000:0.0:1790391481.668309:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:3638:x1877361186475136:12345-0@lo:103:ldlm_bl.0 Request processed in 2974us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391481.668315:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1790391481.668333:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391481.668432:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186475008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391481.668443:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186475136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391481.668461:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790391481.668568:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790391481.668572:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1790391481.668582:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790391481.668640:0:15199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790391481.668654:0:15199:0:(import.c:65:import_set_state_nolock()) ffff9e52b9a88800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790391481.668694:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186475648:0@lo:9:umount.0 00000100:00100000:1.0:1790391481.668732:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790391481.668791:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790391481.668794:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1790391481.668812:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790391481.668867:0:15199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790391481.668938:0:15199:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790391481.669058:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186475776:0@lo:9:umount.0 00000100:00100000:1.0:1790391481.669085:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1790391481.669171:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e52ae8cb380) has no exports 00000100:00100000:2.0:1790391481.669285:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186475648 00000100:00100000:2.0:1790391481.669291:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186475648 00000100:00100000:2.0:1790391481.669359:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186475776 00000100:00100000:2.0:1790391481.669364:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186475776 00000100:00100000:2.0:1790391481.669397:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790391481.669405:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1877361186475648:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790391481.669424:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0dd5 00000100:00080000:2.0:1790391481.669430:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e52b5fb5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391481.669466:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1790391481.669584:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3636:x1877361186475648:12345-0@lo:9:umount.0 Request processed in 180us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391481.669591:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790391481.669604:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790391481.669610:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1877361186475776:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790391481.669621:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0f17 00000100:00080000:2.0:1790391481.669627:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e52b9933800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391481.669655:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1790391481.669718:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3636:x1877361186475776:12345-0@lo:9:umount.0 Request processed in 108us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391481.669724:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1790391481.669740:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391481.669780:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790391481.669791:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391481.669812:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790391481.669826:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790391481.669828:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790391481.669832:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186475776:0@lo:9:umount.0 00000100:00080000:1.0:1790391481.669843:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b9a88800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790391481.669851:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790391481.669853:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790391481.669855:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186475648:0@lo:9:umount.0 00000020:00080000:3.0:1790391481.676459:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e52ae8cb380) has no exports 00000020:00000080:3.0:1790391481.721592:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0afd 00000020:00000080:3.0:1790391481.721610:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52b5cfd000/lustre-QMT0000_UUID 00000020:01000000:3.0:1790391481.721680:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1790391481.721750:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cfd000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1790391481.721777:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391481.721788:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790391481.721792:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9e52b5ca99c0) has no exports 00000020:00000080:2.0:1790391481.722395:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0af6 00000020:00000080:2.0:1790391481.722402:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52b5cbc800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790391481.722461:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cbc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790391481.722527:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391481.722534:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790391481.722538:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52849df800/lustre-QMT0000_UUID 00000020:00000080:2.0:1790391481.722540:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52849df800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1790391481.722544:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1790391482.312485:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391483.336124:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391483.400478:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391483.400503:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186475904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391483.400588:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391483.400708:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186475904 00000100:00100000:3.0:1790391483.400717:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186475904 00000100:00100000:3.0:1790391483.400770:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1790391483.400778:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1877361186475904:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1790391483.400786:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790391483.400831:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1877361186475904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (243us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790391483.400838:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:02020000:0.0:1790391483.400917:0:3638:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1790391483.409580:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790391483.409589:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e52afc90000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790391483.409594:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790391483.426359:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e52afc90000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391483.426392:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 160 00000100:00080000:0.0:1790391483.426402:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e52afc90000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391483.426509:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51831dd500 x1877361186476032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391483.426797:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186476032:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1790391483.426868:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391483.427068:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186476032 00000100:00100000:2.0:1790391483.427075:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186476032 00000100:00100000:2.0:1790391483.427116:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1790391483.427133:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186476032:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1790391483.427151:0:6518:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790391483.429747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186476032:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 2606us (2870us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391483.429760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:0.0:1790391483.429790:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52afc90000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790391483.429796:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790391483.429799:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186476032:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1790391484.360076:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790391484.427022:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790391484.427037:0:8421:0:(genops.c:885:class_export_put()) final put ffff9e52b5fb3800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1790391484.427059:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:3.0:1790391484.427069:0:8421:0:(genops.c:885:class_export_put()) final put ffff9e5287d5c000/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:0.0:1790391484.427130:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5fb3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790391484.427183:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5287d5c000/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d for lustre-OST0000 00000020:00000080:0.0:1790391484.427202:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b5fb5000 for lustre-OST0000 00000020:00000080:0.0:1790391484.427207:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5287d58800 for lustre-OST0000 00000001:00100000:0.0:1790391484.428813:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790391484.428820:0:9505:0:(genops.c:885:class_export_put()) final put ffff9e52b9930000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790391484.428849:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:0.0:1790391484.428851:0:9505:0:(genops.c:885:class_export_put()) final put ffff9e5183a17800/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:3.0:1790391484.430983:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9930000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790391484.431055:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183a17800/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d for lustre-OST0001 00000020:00000080:3.0:1790391484.431074:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b9933800 for lustre-OST0001 00000020:00000080:3.0:1790391484.431079:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5183a15000 for lustre-OST0001 00000001:00100000:2.0:1790391484.434034:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1790391484.434135:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1790391484.434140:0:7444:0:(genops.c:885:class_export_put()) final put ffff9e52b60a7000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1790391484.436655:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6b4e828e-5852-4c32-bc74-22a6cf01e473 00000001:00080000:2.0:1790391484.436667:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1790391484.436671:0:7444:0:(genops.c:885:class_export_put()) final put ffff9e5181cc0000/6b4e828e-5852-4c32-bc74-22a6cf01e473 00000020:00000080:0.0:1790391484.438040:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b60a7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1790391484.440035:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b60a0000 for lustre-MDT0001 00000001:00100000:2.0:1790391484.440444:0:7444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000001:00080000:2.0:1790391484.440453:0:7444:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1790391484.440457:0:7444:0:(genops.c:885:class_export_put()) final put ffff9e5183832000/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d 00000020:00000080:0.0:1790391484.440524:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181cc0000/6b4e828e-5852-4c32-bc74-22a6cf01e473 for lustre-MDT0001 00000020:00000080:0.0:1790391484.440568:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183832000/70c6d8ed-6335-49ea-b8ad-c4d19ba2541d for lustre-MDT0001 00000020:00000080:0.0:1790391484.440591:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5181cc5800 for lustre-MDT0001 00000020:00000080:0.0:1790391484.440595:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5183835000 for lustre-MDT0001 00000040:00080000:2.0:1790391484.494825:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1790391484.936954:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790391484.936962:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790391484.936966:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e52afc90000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391484.936974:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 396 00000100:00080000:3.0:1790391484.936980:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790391484.936987:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e52afc90000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391484.937010:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5288345c00 x1877361186476288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391484.937326:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186476672:0@lo:400:kworker.0 00000100:00100000:1.0:1790391484.937401:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391484.937465:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186477184:0@lo:400:kworker.0 00000100:00100000:2.0:1790391484.937478:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186476288:0@lo:38:kworker.0 00000100:00100000:1.0:1790391484.937495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391484.937571:0:10091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186476672 00000100:00100000:3.0:1790391484.937581:0:10091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186476672 00000100:00100000:3.0:1790391484.937639:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1790391484.937649:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186476672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391484.937749:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186476160:0@lo:400:kworker.0 00000100:00100000:2.0:1790391484.940988:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391484.941619:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186477184 00000100:00100000:2.0:1790391484.941632:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186477184 00000100:00100000:2.0:1790391484.941694:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790391484.941707:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186477184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391484.941729:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186476672:12345-0@lo:400:kworker.0 Request processed in 4078us (4323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391484.941743:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1790391484.941771:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186477184:12345-0@lo:400:kworker.0 Request processed in 66us (4275us total) trans 0 rc 0/0 00000100:00080000:3.0:1790391484.941774:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391484.941780:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391484.941780:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1790391484.941818:0:7840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186476288 00000100:00100000:3.0:1790391484.941824:0:7840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186476288 00000100:00100000:1.0:1790391484.941919:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186477184:0@lo:400:kworker.0 00010000:00080000:1.0:1790391484.941950:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288346680 x1877361186476672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391484.941961:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186476672:0@lo:400:kworker.0 00000100:00100000:1.0:1790391484.941989:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186476416:0@lo:400:kworker.0 00000100:00100000:1.0:1790391484.942025:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391484.942056:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186476928:0@lo:400:kworker.0 00000100:00100000:1.0:1790391484.942098:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391484.944702:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186476416 00000100:00100000:0.0:1790391484.944716:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186476416 00000100:00100000:1.0:1790391484.944729:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790391484.944744:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186476544:0@lo:400:kworker.0 00000100:00100000:0.0:1790391484.944761:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186476928 00000100:00100000:0.0:1790391484.944765:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186476928 00000100:00100000:1.0:1790391484.944799:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391484.944806:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790391484.944816:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1877361186476416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391484.944822:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186477056:0@lo:400:kworker.0 00000020:00080000:0.0:1790391484.944829:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790391484.944849:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391484.944894:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1877361186476416:12345-0@lo:400:kworker.0 Request processed in 78us (2867us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790391484.944902:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790391484.944917:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186476544 00000100:00080000:1.0:1790391484.944919:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1790391484.944921:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186476544 00000100:00080000:1.0:1790391484.944925:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e52b5eaf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790391484.944931:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1790391484.944932:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186477056 00000100:00100000:0.0:1790391484.944936:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186477056 00000100:00100000:0.0:1790391484.944970:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1790391484.944976:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186477056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391484.945012:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186477056:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391484.945019:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1790391484.945795:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790391484.945803:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1877361186476928:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790391484.945809:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790391484.945848:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1877361186476928:12345-0@lo:400:kworker.0 Request processed in 44us (3749us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391484.945853:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790391484.945868:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790391484.945872:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1877361186476544:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790391484.945894:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790391484.945926:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1877361186476544:12345-0@lo:400:kworker.0 Request processed in 52us (1129us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790391484.945931:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1790391484.945954:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790391484.945989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391484.946018:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186476800:0@lo:400:kworker.0 00000100:00100000:2.0:1790391484.946500:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391484.946617:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186476160 00000100:00100000:2.0:1790391484.946628:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186476160 00000100:00100000:2.0:1790391484.946662:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1790391484.946669:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:3638:x1877361186476160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391484.946707:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a75efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8c24317-3e12-4efa-bd41-8d3f5086c0ea+19:3638:x1877361186476160:12345-0@lo:400:kworker.0 Request processed in 39us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391484.946714:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1790391484.946754:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3638:1877361186476160:0@lo:400:kworker.0 00000100:00100000:3.0:1790391484.950414:0:7840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1790391484.950428:0:7840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1877361186476288:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1790391484.950447:0:7840:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790391484.951139:0:10505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186476800 00000100:00100000:0.0:1790391484.951149:0:10505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186476800 00000100:00100000:0.0:1790391484.951230:0:10505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1790391484.951238:0:10505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186476800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391484.951326:0:10505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186476800:12345-0@lo:400:kworker.0 Request processed in 89us (4825us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391484.951333:0:10505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1790391484.951847:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e52b5eaf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391484.951856:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 160 00000100:00080000:1.0:1790391484.951863:0:3639:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e52b5eaf800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391484.952009:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186476800:0@lo:400:kworker.0 00000100:00100000:0.0:1790391484.952129:0:3639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51838f5c00 x1877361186477312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391484.952151:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186476416:0@lo:400:kworker.0 00000100:00080000:0.0:1790391484.952169:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790391484.952182:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790391484.952186:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790391484.952191:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391484.952195:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 203 00000100:00080000:0.0:1790391484.952200:0:3639:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e5182f5b000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391484.952214:0:3639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e51831dd500 x1877361186477440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391484.952226:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186476928:0@lo:400:kworker.0 00000100:00080000:0.0:1790391484.952248:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790391484.952251:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e5181f62800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790391484.952254:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790391484.952257:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e5181f62800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391484.952260:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 181 00000100:00080000:0.0:1790391484.952264:0:3639:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5181f62800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391484.952276:0:3639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183bbd180 x1877361186477568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391484.952286:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186476544:0@lo:400:kworker.0 00010000:00080000:0.0:1790391484.952300:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183a43100 x1877361186477056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391484.952308:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186477056:0@lo:400:kworker.0 00000100:00080000:2.0:1790391484.955990:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391484.956025:0:7840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1877361186476288:12345-0@lo:38:kworker.0 Request processed in 5589us (15037us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391484.956025:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186477312:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1790391484.956043:0:7840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1790391484.956076:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391484.956103:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186477312 00000100:00100000:2.0:1790391484.956109:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186477440:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1790391484.956135:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391484.956154:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186477568:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1790391484.956175:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391484.956210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186477440 00000100:00080000:2.0:1790391484.956216:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52afc90000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1790391484.956219:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186477440 00000100:00080000:2.0:1790391484.956224:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391484.956229:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186476288:0@lo:38:kworker.0 00000100:00100000:1.0:1790391484.956255:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186477568 00000100:00100000:1.0:1790391484.956259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186477568 00000100:00100000:2.0:1790391484.956266:0:10091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790391484.956286:0:10091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186477440:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1790391484.956304:0:10091:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790391484.956335:0:10091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1877361186477440:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 49us (200us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391484.956342:0:10091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1790391484.956351:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790391484.956359:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186477568:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1790391484.956369:0:6512:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1790391484.956371:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391484.956376:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391484.956379:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186477440:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1790391484.956413:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186477568:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 53us (236us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790391484.956421:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1790391484.956428:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5181f62800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391484.956433:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391484.956436:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186477568:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1790391484.956471:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186477312 00000100:00100000:3.0:1790391484.956503:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790391484.956578:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186477312:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1790391484.956589:0:6514:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790391484.956631:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186477312:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 122us (556us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790391484.956637:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1790391484.956710:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5eaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391484.956715:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790391484.956719:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186477312:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1790391485.385786:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391485.448081:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186477696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391485.448151:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391485.448345:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186477696 00000100:00100000:3.0:1790391485.448354:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186477696 00000100:00100000:3.0:1790391485.448407:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790391485.448419:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186477696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790391485.448448:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790391485.448504:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186477696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391485.448512:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790391485.448739:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186477696:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1790391485.451592:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790391485.451602:0:6491:0:(genops.c:885:class_export_put()) final put ffff9e52b9932800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1790391485.451679:0:6491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6b4e828e-5852-4c32-bc74-22a6cf01e473 00000020:00000080:1.0:1790391485.451683:0:6491:0:(genops.c:885:class_export_put()) final put ffff9e5181cc3800/6b4e828e-5852-4c32-bc74-22a6cf01e473 00000020:00000080:3.0:1790391485.456764:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9932800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1790391485.456909:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b9a89800 for lustre-MDT0000 00000020:00000080:3.0:1790391485.457415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181cc3800/6b4e828e-5852-4c32-bc74-22a6cf01e473 for lustre-MDT0000 00000020:00000080:3.0:1790391485.457444:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5181cc1800 for lustre-MDT0000 00010000:00010000:0.0:1790391486.410624:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391486.472569:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391486.472590:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186477824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391486.472663:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391486.472751:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186477824 00000100:00100000:2.0:1790391486.472758:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186477824 00000100:00100000:2.0:1790391486.472834:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790391486.472845:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186477824:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790391486.472871:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1790391486.472903:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790391486.472953:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186477824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391486.472960:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790391486.473219:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186477824:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790391487.432981:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790391487.818425:0:15199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e51830eb960 - data ffff9e51818e1ca8/ffff9e51832d1c00 00000020:01000000:3.0:1790391487.818635:0:15199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e529e92cde0 - data ffff9e52a558f1b0/ffff9e52b5ed8800 00000001:00000004:3.0:1790391487.838089:0:15199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1790391487.902850:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790391487.902860:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1790391487.904595:0:15199:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e5288345880 x1877361186475520/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790391491 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391487.904638:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1790391487.908565:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790391487.908574:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1790391487.908600:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790391487.908603:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790391487.909018:0:8831:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790391487.909024:0:8831:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1790391487.909034:0:8831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1790391487.910359:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790391487.910365:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1790391487.910381:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790391487.910384:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790391487.910807:0:9789:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790391487.910822:0:9789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1790391487.910833:0:9789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1790391487.917023:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0ac5 00000020:00000080:0.0:1790391487.917038:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5284980000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790391487.922005:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284980000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790391487.923076:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0ada 00000020:00000080:0.0:1790391487.923091:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52849db000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790391487.923105:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790391487.923112:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391487.923120:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790391487.923125:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9e52ae8c8000) has no exports 00000020:00000080:3.0:1790391487.923286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52849db000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1790391487.923296:0:15199:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790391487.923307:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0f10 00000020:00000080:0.0:1790391487.923312:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5183374000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790391487.923328:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790391487.923332:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391487.923341:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790391487.923349:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9e5183384d40) has no exports 00000020:00000080:0.0:1790391487.923356:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0f09 00000020:00000080:0.0:1790391487.923360:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5182f58800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790391487.923386:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183374000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1790391487.923397:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182f58800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790391487.923874:0:15199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790391487.923901:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790391487.923905:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1790391487.923912:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790391487.923914:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790391487.923951:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391487.923954:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182f5f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790391487.923960:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790391487.923965:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5182f5a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790391487.923969:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182f5a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790391487.923975:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790391487.924067:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0dce 00000020:00000080:0.0:1790391487.924074:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52bf9b7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790391487.924092:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790391487.924095:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391487.924101:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790391487.924104:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9e52b9d74d40) has no exports 00000020:00000080:0.0:1790391487.924108:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0dc7 00000020:00000080:0.0:1790391487.924110:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5287625800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790391487.924204:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52bf9b7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1790391487.924214:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5287625800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790391487.924470:0:15199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790391487.924473:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790391487.924475:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1790391487.924479:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790391487.924480:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790391487.924518:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391487.924523:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1790391487.924533:0:15199:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1790391487.924538:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0c7e 00000020:00000080:0.0:1790391487.924542:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52b75c5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790391487.924546:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1790391487.924549:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391487.924552:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790391487.924554:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e52b5cab380) has no exports 00000020:00000080:0.0:1790391487.924564:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0c77 00000020:00000080:0.0:1790391487.924566:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52b7487800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790391487.924585:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b9a88800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1790391487.924594:0:36:0:(genops.c:885:class_export_put()) final put ffff9e528493b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790391487.924597:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e528493b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1790391487.924604:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790391487.924658:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b75c5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1790391487.924664:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b7487800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1790391487.973943:0:15199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1790391487.973954:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790391487.973960:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1790391487.973972:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790391487.974032:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391487.974045:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790391487.974078:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391487.974081:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790391487.974087:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5284985800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790391487.974092:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284985800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1790391487.974106:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790391487.974215:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0ae1 00000020:00000080:2.0:1790391487.974222:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52849de000/lustre-MDD0000_UUID 00000020:01000000:2.0:1790391487.974228:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1790391487.974231:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391487.974235:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790391487.974239:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9e52ae8ccd40) has no exports 00000020:00000080:2.0:1790391487.974258:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391487.974261:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1790391487.974265:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0ae8 00000020:00000080:2.0:1790391487.974269:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e52849d9000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790391487.974277:0:15199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5289da8000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1790391487.974280:0:15199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5289da8000 3 00000020:01000004:2.0:1790391487.974283:0:15199:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e5289da8000 from lustre-MDT0000 00000020:00000080:2.0:1790391487.974300:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391487.974303:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1790391487.974305:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5284986800/lustre-MDT0000_UUID 00000020:00000080:2.0:1790391487.974308:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284986800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1790391487.974314:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1790391487.974340:0:15199:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1790391487.974343:0:15199:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1790391487.974345:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1790391487.974359:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391487.974362:0:15199:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790391487.974370:0:15199:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9e52afeed800 c8c24317-3e12-4efa-bd41-8d3f5086c0ea 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790391487.974377:0:15199:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9e5290bf3380) has exports, disconnecting them 00000020:00080000:2.0:1790391487.974381:0:15199:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e52afeed800), last request at 1790391227 00000020:00000080:2.0:1790391487.974396:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0a86 00000020:00010000:2.0:1790391487.974401:0:15199:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e52afeed800: total 2 00000100:00080000:2.0:1790391487.974406:0:15199:0:(import.c:65:import_set_state_nolock()) ffff9e52afeea000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790391487.974423:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e52afeed800): rc 0 00000020:00080000:2.0:1790391487.974428:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9e5290bf3380) has no exports 00000020:00010000:2.0:1790391487.974440:0:6501:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e52afeed800: total 2 00010000:00010000:2.0:1790391487.974469:0:6501:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e52afeed800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1790391487.974525:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eeec00/0x2b1b7949f13e1227 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e1220 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974542:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295145000/0x2b1b7949f13e0fb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0fb1 expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974553:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b763cc00/0x2b1b7949f13e1235 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e122e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974564:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566d200/0x2b1b7949f13e0b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0b89 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974577:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52c21f6200/0x2b1b7949f13e0faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0fa3 expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974589:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144600/0x2b1b7949f13e0f87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0f80 expref: 9 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974599:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52813a3e00/0x2b1b7949f13e0fc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0fbf expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974616:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52813a3200/0x2b1b7949f13e0f95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0f8e expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974625:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144c00/0x2b1b7949f13e0fd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0fcd expref: 6 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974635:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566d600/0x2b1b7949f13e0ea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0ea0 expref: 5 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974647:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e529566dc00/0x2b1b7949f13e0b82 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0b7b expref: 4 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974657:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183086a00/0x2b1b7949f13e1219 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e1212 expref: 3 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974668:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144e00/0x2b1b7949f13e0ffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2b1b7949f13e0ff7 expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391487.974678:0:6501:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e52afeed800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1790391487.974691:0:6501:0:(genops.c:885:class_export_put()) final put ffff9e52afeed800/c8c24317-3e12-4efa-bd41-8d3f5086c0ea 00010000:00010000:2.0:1790391487.974697:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391487.974699:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391487.974701:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391487.974761:0:6507:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e52a0989c00:6507] 2 exiting: rc = 0 00000100:00100000:2.0:1790391487.974871:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e529e923600:6506] 1 exiting: rc = 0 00000020:00000080:3.0:1790391487.975042:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b7482800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1790391487.975049:0:36:0:(genops.c:885:class_export_put()) final put ffff9e52b7484000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790391487.975052:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b7484000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1790391487.975059:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790391487.975108:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52849de000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1790391487.975111:0:36:0:(genops.c:885:class_export_put()) final put ffff9e5284986000/lustre-MDD0000_UUID 00000020:00000080:3.0:1790391487.975113:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284986000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1790391487.975116:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1790391487.975136:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52849d9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790391487.975140:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52afeed800/c8c24317-3e12-4efa-bd41-8d3f5086c0ea for MGS 00000020:00000080:3.0:1790391487.975175:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52afeea000 for MGS 00000100:00100000:1.0:1790391487.982783:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e52903eac00:6505] 0 exiting: rc = 1 00000100:00100000:2.0:1790391487.982863:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982894:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982905:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982912:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982920:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982938:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982945:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982953:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982961:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982969:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982977:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982986:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.982995:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983002:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983009:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983018:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983025:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983033:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983040:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983049:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983056:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983066:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983074:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983082:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983088:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983096:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983105:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983116:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983127:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983133:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983144:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983222:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983229:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983234:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983240:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983246:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983252:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983258:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983264:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983270:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983282:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983288:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983293:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983300:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983305:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983311:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983317:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983321:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983326:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983331:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983336:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983340:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983345:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983350:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983354:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983360:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983366:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983371:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983377:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983381:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983386:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983391:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983397:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391487.983403:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1790391487.984624:0:15199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5182fd7e40 - data ffff9e529186bbd0/ffff9e52b9c3fc00 00000020:01000000:2.0:1790391487.984748:0:15199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e5284e91900 - data ffff9e5291983d80/ffff9e5285261800 00000020:00000080:2.0:1790391487.985201:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0a6a 00000020:00000080:2.0:1790391487.985212:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5284ede000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790391487.985229:0:15199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5289da8000 from MGS, refs=2 00000020:01000004:2.0:1790391487.985233:0:15199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5289da8000 2 00000020:01000004:2.0:1790391487.985236:0:15199:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e5289da8000 from MGS 00000020:00000080:2.0:1790391487.985348:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391487.985355:0:15199:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1790391487.985359:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5284e31000/MGS 00000020:00000080:2.0:1790391487.985373:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284e31000/MGS for MGS 00000020:01000000:2.0:1790391487.985380:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1790391487.985454:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1790391487.985458:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391487.985466:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790391487.985473:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e5284981800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790391487.985478:0:15199:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9e5290bf19c0) has exports, disconnecting them 00000020:00080000:2.0:1790391487.985483:0:15199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e5284981800), last request at 1790391227 00000020:00000080:2.0:1790391487.985488:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0b35 00000020:00080000:2.0:1790391487.985497:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5284981800): rc 0 00000020:00000080:2.0:1790391487.985513:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5284981800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790391487.986187:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284ede000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790391487.986210:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5284981800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1790391487.986236:0:15199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1790391487.986239:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790391487.986243:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790391487.986249:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391487.986268:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5284980800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790391487.986415:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391487.986421:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790391487.986425:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e528493d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790391487.986428:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff9e528493d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790391487.986432:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1790391487.986487:0:15199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5289da8000 1 00000020:00000080:3.0:1790391487.986490:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0a5c 00000020:00000080:3.0:1790391487.986494:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5289dac800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1790391487.986512:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1790391487.986518:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5289dac800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790391487.986525:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391487.986528:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790391487.986530:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9e5290bf0000) has no exports 00000020:00000080:1.0:1790391488.067161:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391488.067178:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790391488.067184:0:15199:0:(genops.c:885:class_export_put()) final put ffff9e5289dad800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790391488.067189:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5289dad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790391488.067203:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790391488.067328:0:15199:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e5289dae800 00000020:02000400:0.0:1790391488.067731:0:15199:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1790391488.456063:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391489.480784:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790391490.056919:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391490.056926:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790391490.056930:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e52afc90000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391490.056938:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 398 00000100:00080000:2.0:1790391490.056944:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790391490.056951:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e52afc90000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391490.056986:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5288345880 x1877361186478080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391490.057002:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391490.057006:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790391490.057007:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e52b5eaf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391490.057010:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 398 00000100:00080000:2.0:1790391490.057013:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391490.057016:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e52b5eaf800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391490.057027:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5288345c00 x1877361186478208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391490.057044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391490.057047:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790391490.057048:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e5181f62800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391490.057051:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 398 00000100:00080000:2.0:1790391490.057054:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391490.057057:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5181f62800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391490.057080:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5288347800 x1877361186478336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391490.057107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391490.057111:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790391490.057112:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391490.057115:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 398 00000100:00080000:2.0:1790391490.057118:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391490.057122:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e5182f5b000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391490.057130:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5288346300 x1877361186478720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391490.057170:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186477952:0@lo:400:kworker.0 00000400:00000100:2.0:1790391490.057219:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877361186477952 offset 0 length 224: 4 00000100:00100000:2.0:1790391490.057264:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186478976:0@lo:400:kworker.0 00000100:00100000:2.0:1790391490.057292:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391490.057319:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391490.057324:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186478848:0@lo:400:kworker.0 00000100:00100000:2.0:1790391490.057349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391490.057387:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186478080:0@lo:38:kworker.0 00000100:00100000:2.0:1790391490.057412:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391490.057428:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186478208:0@lo:38:kworker.0 00000100:00100000:2.0:1790391490.057447:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391490.057462:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186478336:0@lo:38:kworker.0 00000100:00100000:2.0:1790391490.057494:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391490.057512:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186478720:0@lo:38:kworker.0 00000100:00100000:2.0:1790391490.057532:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391490.057557:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186478464:0@lo:400:kworker.0 00000100:00100000:2.0:1790391490.057576:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391490.057587:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391490.057591:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186478592:0@lo:400:kworker.0 00000100:00100000:2.0:1790391490.057610:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391490.057646:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186478976 00000100:00100000:2.0:1790391490.057653:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186478976 00000100:00100000:2.0:1790391490.057702:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186478592 00000100:00100000:2.0:1790391490.057705:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186478592 00000100:00100000:2.0:1790391490.057729:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790391490.057738:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186478976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391490.057787:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186478976:12345-0@lo:400:kworker.0 Request processed in 50us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391490.057794:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790391490.057809:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790391490.057815:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186478592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391490.057846:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186478592:12345-0@lo:400:kworker.0 Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391490.057860:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790391490.057899:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186478848 00000100:00100000:2.0:1790391490.057903:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186478848 00000100:00100000:2.0:1790391490.057922:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186478208 00000100:00100000:2.0:1790391490.057925:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186478208 00000100:00100000:2.0:1790391490.057932:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186478336 00000100:00100000:2.0:1790391490.057934:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186478336 00000100:00100000:2.0:1790391490.057941:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186478720 00000100:00100000:2.0:1790391490.057943:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186478720 00000100:00100000:2.0:1790391490.057949:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186478464 00000100:00100000:2.0:1790391490.057951:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186478464 00000100:00100000:2.0:1790391490.057964:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1790391490.057970:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186478848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391490.058000:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877361186478848:12345-0@lo:400:kworker.0 Request processed in 30us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391490.058006:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1790391490.058017:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1790391490.058022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186478464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391490.058046:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186478464:12345-0@lo:400:kworker.0 Request processed in 24us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391490.058052:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1790391490.058064:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790391490.058067:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186478208:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790391490.058085:0:6512:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790391490.058116:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186478208:12345-0@lo:38:kworker.0 Request processed in 47us (667us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391490.058122:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790391490.058138:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1790391490.058142:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186478336:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790391490.058152:0:6512:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790391490.058175:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186478336:12345-0@lo:38:kworker.0 Request processed in 32us (681us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391490.058181:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1790391490.058191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1790391490.058194:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186478720:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790391490.058202:0:6512:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790391490.058222:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186478720:12345-0@lo:38:kworker.0 Request processed in 27us (689us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391490.058228:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1790391490.058245:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186478080 00000100:00100000:2.0:1790391490.058248:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186478080 00000100:00100000:2.0:1790391490.058268:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1790391490.058272:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186478080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790391490.058281:0:6518:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790391490.058306:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186478080:12345-0@lo:38:kworker.0 Request processed in 32us (893us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790391490.058312:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:2.0:1790391490.058339:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391490.058343:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790391490.058345:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391490.058382:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186478592:0@lo:400:kworker.0 00010000:00080000:2.0:1790391490.058394:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e5288344e00 x1877361186478464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391490.058415:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186478464:0@lo:400:kworker.0 00000100:00080000:2.0:1790391490.058449:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52afc90000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391490.058454:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391490.058457:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186478080:0@lo:38:kworker.0 00000100:00080000:2.0:1790391490.058466:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5eaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391490.058469:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391490.058471:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186478208:0@lo:38:kworker.0 00000100:00080000:2.0:1790391490.058491:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5181f62800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391490.058495:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391490.058498:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186478336:0@lo:38:kworker.0 00000100:00080000:2.0:1790391490.058507:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391490.058510:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391490.058513:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186478720:0@lo:38:kworker.0 00010000:00080000:2.0:1790391490.058539:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e5284947480 x1877361186478848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391490.058549:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186478848:0@lo:400:kworker.0 00000100:00100000:2.0:1790391490.058558:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186478976:0@lo:400:kworker.0 00010000:00010000:0.0:1790391490.504198:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391490.568052:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186479104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391490.568139:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391490.568328:0:10518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186479104 00000100:00100000:1.0:1790391490.568337:0:10518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186479104 00000100:00100000:1.0:1790391490.568393:0:10518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790391490.568403:0:10518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186479104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391490.568433:0:10518:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790391490.568496:0:10518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186479104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391490.568503:0:10518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790391490.568956:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186479104:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1790391491.533328:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391491.592816:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186479232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391491.592908:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391491.593544:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186479232 00000100:00100000:3.0:1790391491.593554:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186479232 00000100:00100000:3.0:1790391491.593624:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790391491.593635:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186479232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790391491.593741:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790391491.593809:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186479232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 176us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391491.593817:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790391491.593856:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186479232:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1790391491.695547:0:15400:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1790391491.718064:0:15400:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1790391491.718115:0:15400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.718131:0:15400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.718139:0:15400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.718145:0:15400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.718171:0:15400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790391491.718177:0:15400:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790391491.718200:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391491.718205:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790391491.718212:0:15400:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790391491.718218:0:15400:0:(import.c:65:import_set_state_nolock()) ffff9e52b5eaf800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790391491.718223:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391491.718225:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790391491.718228:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790391491.718844:0:13724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391491.718864:0:13724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391491.718873:0:13724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145200 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391491.718897:0:13724:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391491.718906:0:13724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391491.718915:0:13724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391491.718920:0:13724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790391491.718923:0:13724:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790391491.718925:0:13724:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790391491.719429:0:13724:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391491.719438:0:13724:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391491.719475:0:13724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391491.719483:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295145200/0x2b1b7949f13e0fbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0fc6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391491.719498:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391491.719499:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391491.719502:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391491.719547:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391491.719567:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186479360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391491.719642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391491.719808:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186479360 00000100:00100000:3.0:1790391491.719815:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186479360 00000100:00100000:3.0:1790391491.719863:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790391491.719902:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52ae9fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3640:x1877361186479360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790391491.719908:0:10388:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391491 with bad export cookie 3106209726489037446 00010000:00010000:2.0:1790391491.722024:0:15400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722137:0:15400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722146:0:15400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722175:0:15400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722200:0:15400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391491.722207:0:15400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722215:0:15400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722221:0:15400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722227:0:15400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722290:0:15400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790391491.722298:0:15400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722304:0:15400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722309:0:15400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.722315:0:15400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724248:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790391491.724261:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724273:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f7000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391491.724277:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724304:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391491.724312:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391491.724318:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391491.724321:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1790391491.724371:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724377:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391491.724400:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724407:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7000/0x2b1b7949f13e0fcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0fd4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724424:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391491.724428:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724433:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e529566d400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391491.724435:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724442:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391491.724447:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391491.724459:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790391491.724461:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1790391491.724476:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1790391491.724493:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724499:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391491.724515:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724523:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e529566d400/0x2b1b7949f13e0ea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0ea7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724537:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391491.724542:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724547:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087400 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391491.724550:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724557:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391491.724563:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391491.724568:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790391491.724571:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1790391491.724583:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724594:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391491.724601:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391491.724609:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391491.724611:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391491.724613:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391491.724638:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186479616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391491.724711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391491.724763:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391491.724769:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186479744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391491.724791:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391491.724823:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391491.724830:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186479488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391491.724853:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391491.724897:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186479616 00000100:00100000:1.0:1790391491.724904:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186479616 00000100:00100000:1.0:1790391491.724931:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186479744 00000100:00100000:1.0:1790391491.724934:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186479744 00000100:00100000:1.0:1790391491.724955:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186479488 00000100:00100000:1.0:1790391491.724958:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186479488 00000100:00100000:1.0:1790391491.724971:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790391491.724978:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51838f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1877361186479616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790391491.724984:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391491 with bad export cookie 3106209726489037446 00000100:00100000:1.0:1790391491.725029:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51838f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1877361186479616:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (317us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790391491.725036:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790391491.725059:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391491.725064:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1877361186479744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790391491.725069:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391491 with bad export cookie 3106209726489037446 00000100:00100000:1.0:1790391491.725095:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3637:x1877361186479744:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (303us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790391491.725101:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391491.725114:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790391491.725118:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3639:x1877361186479488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790391491.725122:0:6499:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790391491 with bad export cookie 3106209726489037446 00000100:00100000:1.0:1790391491.725149:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3639:x1877361186479488:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (295us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790391491.725155:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1790391491.725182:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.128@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790391491.725187:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e52877fe000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790391491.725190:0:3639:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.128@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1790391491.731324:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52ae9fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3640:x1877361186479360:12345-0@lo:103:ldlm_bl.0 Request processed in 11417us (11677us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790391491.731337:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1790391491.732747:0:15400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790391491.732760:0:15400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e122e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e1235 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391491.732780:0:15400:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790391491.732796:0:15400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.732804:0:15400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.732811:0:15400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.732819:0:15400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391491.732836:0:15400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790391491.732840:0:15400:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1790391491.732843:0:15400:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1790391491.732900:0:15400:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1790391491.732905:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1790391491.732910:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391491.732916:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1790391491.732923:0:15400:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9e5181f63800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790391491.732929:0:15400:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9e5181cc0800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790391491.732935:0:15400:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9e52b5ef99c0) has exports, disconnecting them 00000020:00080000:2.0:1790391491.732939:0:15400:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e5181f63800), last request at 1790391490 00000020:00000080:2.0:1790391491.732962:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0e68 00000100:00080000:2.0:1790391491.732980:0:15400:0:(import.c:65:import_set_state_nolock()) ffff9e5181f60800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790391491.733033:0:15400:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5181f63800): rc 0 00000020:00000080:2.0:1790391491.733036:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e5181f63800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1790391491.733058:0:15400:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e5181cc0800), last request at 1790391490 00000020:00000080:2.0:1790391491.733061:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0d42 00000100:00080000:2.0:1790391491.733066:0:15400:0:(import.c:65:import_set_state_nolock()) ffff9e5181cc4000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1790391491.733076:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f63800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1790391491.733118:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5181f60800 for lustre-MDT0001 00000020:00080000:2.0:1790391491.733130:0:15400:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5181cc0800): rc 0 00000020:00000080:2.0:1790391491.733132:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e5181cc0800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1790391491.733142:0:15400:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffab84015a3ae0 00000020:00000080:2.0:1790391491.733152:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181cc0800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1790391491.733171:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5181cc4000 for lustre-MDT0001 00000100:00080000:2.0:1790391491.733187:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391491.733196:0:15400:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9e51831dc380 x1877361186475904/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790391499 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391491.733213:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1790391491.734137:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186475904:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1790391491.734171:0:15400:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790391491.734175:0:15400:0:(import.c:65:import_set_state_nolock()) ffff9e52afc90000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1790391491.734541:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391491.734550:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391491.734560:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030200 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391491.734564:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391491.734574:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391491.734582:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391491.734587:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790391491.734590:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790391491.734593:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790391491.735157:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391491.735208:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.128@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1790391491.735284:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790391491.737132:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790391491.737139:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1790391491.737154:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790391491.737214:0:15400:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790391491.737242:0:15400:0:(import.c:65:import_set_state_nolock()) ffff9e52b5fb1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1790391491.737271:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790391491.737274:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1790391491.737282:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790391491.737365:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186479872:0@lo:9:umount.0 00000100:00100000:2.0:1790391491.737429:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790391491.737492:0:15400:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790391491.737503:0:15400:0:(import.c:65:import_set_state_nolock()) ffff9e5183332800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790391491.737520:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186480000:0@lo:9:umount.0 00000100:00100000:2.0:1790391491.737545:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391491.737575:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186479872 00000100:00100000:2.0:1790391491.737581:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186479872 00000100:00100000:2.0:1790391491.737622:0:9796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186480000 00000100:00100000:2.0:1790391491.737626:0:9796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186480000 00000100:00100000:2.0:1790391491.737646:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790391491.737654:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1877361186479872:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790391491.737678:0:9796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0d8f 00000100:00080000:2.0:1790391491.737687:0:9796:0:(import.c:65:import_set_state_nolock()) ffff9e52baf88800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391491.737724:0:9796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1790391491.737863:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3636:x1877361186479872:12345-0@lo:9:umount.0 Request processed in 209us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391491.737869:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790391491.737912:0:9796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790391491.737919:0:9796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1877361186480000:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790391491.737931:0:9796:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0ed8 00000100:00080000:2.0:1790391491.737937:0:9796:0:(import.c:65:import_set_state_nolock()) ffff9e5182265000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790391491.737959:0:9796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1790391491.738031:0:9796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3636:x1877361186480000:12345-0@lo:9:umount.0 Request processed in 112us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391491.738045:0:9796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1790391491.738070:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790391491.738097:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183332800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790391491.738106:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790391491.738108:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790391491.738112:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186480000:0@lo:9:umount.0 00000100:00080000:2.0:1790391491.738123:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5fb1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790391491.738125:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790391491.738127:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790391491.738128:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186479872:0@lo:9:umount.0 00000020:00080000:2.0:1790391491.738172:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e52b5ef99c0) has no exports 00000100:00080000:1.0:1790391491.746783:0:3639:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.128@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790391491.746790:0:3639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790391491.746801:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e51831dd500 x1877361186477952/t0(0) o400->MGC192.168.202.128@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790391506 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391491.746817:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5183a43b80 x1877361186479360/t0(0) o103->MGC192.168.202.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391507 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391491.746826:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e51838f6680 x1877361186479616/t0(0) o103->MGC192.168.202.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391507 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391491.746835:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e51838f7480 x1877361186479744/t0(0) o103->MGC192.168.202.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391507 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391491.746842:0:3639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e51838f5c00 x1877361186479488/t0(0) o103->MGC192.168.202.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790391507 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790391491.746873:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790391491.746905:0:3639:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790391491.746906:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:3.0:1790391491.747318:0:6501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391491.747329:0:6501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391491.747408:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391491.747416:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280030200/0x2b1b7949f13e0b89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2b1b7949f13e0b90 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391491.747450:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391491.747451:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391491.747454:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391491.747527:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e52877fe000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1790391491.747553:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186477952:0@lo:400:kworker.0 00000100:00100000:0.0:1790391491.747580:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3640:1877361186479360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391491.747589:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391491.747596:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:0:1877361186480128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391491.747740:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391491.747791:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186479744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391491.747799:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3637:1877361186479616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391491.747822:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790391491.747852:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e52877fe000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391491.747858:0:3639:0:(import.c:545:import_select_connection()) MGC192.168.202.128@tcp: connect to NID 0@lo last attempt 140 00000100:00080000:1.0:1790391491.747867:0:3639:0:(import.c:665:import_select_connection()) MGC192.168.202.128@tcp: import ffff9e52877fe000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391491.748449:0:3639:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183b7e300 x1877361186480256/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391491.748491:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51838f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3639:1877361186479488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391491.748682:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3636:1877361186480256:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1790391491.748731:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877361186480256 offset 0 length 520: 4 00000020:00080000:2.0:1790391491.764457:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e52b5ef99c0) has no exports 00000020:01000000:3.0:1790391491.826797:0:15400:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e51830eb060 - data ffff9e51818e1798/ffff9e51832d3000 00000020:01000000:3.0:1790391491.827154:0:15400:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e528550fa80 - data ffff9e52a562f6c0/ffff9e52b6e00000 00000001:00000004:3.0:1790391491.837509:0:15400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1790391491.885684:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391491.885696:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1790391491.885705:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1790391491.887758:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790391491.887765:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1790391491.887777:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790391491.887779:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790391491.888303:0:8823:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790391491.888308:0:8823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1790391491.888319:0:8823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790391491.888850:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790391491.888854:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1790391491.888871:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790391491.888873:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790391491.889153:0:9781:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790391491.889156:0:9781:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1790391491.889162:0:9781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1790391491.889925:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0bac 00000020:00000080:2.0:1790391491.889935:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b608d000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790391491.890453:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b608d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1790391491.893172:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0bc1 00000020:00000080:2.0:1790391491.893188:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b60a5000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790391491.893208:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1790391491.893213:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391491.893232:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790391491.893237:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9e52b5efcd40) has no exports 00000004:01000000:2.0:1790391491.893425:0:15400:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790391491.893435:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0eca 00000020:00000080:2.0:1790391491.893440:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e5182265800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790391491.893445:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790391491.893449:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391491.893456:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790391491.893459:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9e52b9aa8000) has no exports 00000020:00000080:2.0:1790391491.893475:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0ec3 00000020:00000080:2.0:1790391491.893478:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e5183337800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1790391491.893815:0:15400:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1790391491.893820:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790391491.893826:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1790391491.893831:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790391491.893833:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790391491.893866:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391491.893906:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790391491.893913:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0d88 00000020:00000080:2.0:1790391491.893918:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b5fb7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790391491.893922:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790391491.893926:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391491.893930:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790391491.893932:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9e52b9aa99c0) has no exports 00000020:00000080:2.0:1790391491.893937:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0d81 00000020:00000080:2.0:1790391491.893939:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b5fb0000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1790391491.894260:0:15400:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1790391491.894263:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790391491.894266:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1790391491.894269:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790391491.894271:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790391491.894291:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391491.894301:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1790391491.894309:0:15400:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790391491.894314:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0be4 00000020:00000080:2.0:1790391491.894318:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b9a88000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790391491.894322:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1790391491.894324:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391491.894327:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790391491.894329:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9e52b5ca8000) has no exports 00000020:00000080:2.0:1790391491.894333:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0bdd 00000020:00000080:2.0:1790391491.894335:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52afc97800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790391491.895149:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b60a5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1790391491.895158:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182265800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790391491.895163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183337800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790391491.895169:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5183332800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790391491.895174:0:36:0:(genops.c:885:class_export_put()) final put ffff9e5183334000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790391491.895176:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5183334000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1790391491.895179:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790391491.895250:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5fb7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790391491.895255:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5fb0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790391491.895259:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b5fb1000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790391491.895261:0:36:0:(genops.c:885:class_export_put()) final put ffff9e5181cc6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790391491.895263:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181cc6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1790391491.895266:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790391491.895288:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9a88000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1790391491.895292:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52afc97800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1790391491.895317:0:15400:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1790391491.895320:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790391491.895322:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1790391491.895334:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391491.895363:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391491.895368:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790391491.895391:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391491.895393:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790391491.895397:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b608c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790391491.895399:0:15400:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b608c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1790391491.895402:0:15400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790391491.895529:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0bc8 00000020:00000080:3.0:1790391491.895534:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b60a1800/lustre-MDD0001_UUID 00000020:01000000:3.0:1790391491.895537:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1790391491.895540:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391491.895543:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790391491.895546:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9e52b5ef8000) has no exports 00000020:00000080:3.0:1790391491.895564:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391491.895566:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1790391491.895569:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0bcf 00000020:00000080:3.0:1790391491.895572:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b60a5800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1790391491.895578:0:15400:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52b5eaa800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1790391491.895581:0:15400:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b5eaa800 2 00000020:01000004:3.0:1790391491.895584:0:15400:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e52b5eaa800 from lustre-MDT0001 00000020:00000080:3.0:1790391491.895600:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391491.895603:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1790391491.895605:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b6089800/lustre-MDT0001_UUID 00000020:00000080:3.0:1790391491.895607:0:15400:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b6089800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1790391491.895612:0:15400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1790391491.895637:0:15400:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1790391491.895640:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1790391491.895642:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391491.895645:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790391491.895651:0:15400:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9e52b6089000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790391491.895664:0:15400:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9e52b9aab380) has exports, disconnecting them 00000020:00080000:3.0:1790391491.895668:0:15400:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9e52b6089000), last request at 1790391247 00000020:00000080:3.0:1790391491.895671:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0c23 00000020:00080000:3.0:1790391491.895681:0:15400:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e52b6089000): rc 0 00000020:00000080:3.0:1790391491.895684:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b6089000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1790391491.896364:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52afc90000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790391491.896373:0:36:0:(genops.c:885:class_export_put()) final put ffff9e52afc97000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790391491.896375:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52afc97000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1790391491.896380:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790391491.896479:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b60a1800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1790391491.896483:0:36:0:(genops.c:885:class_export_put()) final put ffff9e52b608a800/lustre-MDD0001_UUID 00000020:00000080:0.0:1790391491.896486:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b608a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1790391491.896489:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1790391491.896650:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b60a5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790391491.896655:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b6089000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1790391491.900968:0:15400:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1790391491.900977:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790391491.900981:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790391491.900989:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790391491.901018:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b5eaf800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1790391491.901221:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391491.901240:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1790391491.901246:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b60a3800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1790391491.901249:0:15400:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b60a3800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1790391491.901255:0:15400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1790391491.901332:0:15400:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b5eaa800 1 00000020:00000080:0.0:1790391491.901348:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0b5f 00000020:00000080:0.0:1790391491.901356:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b5cfe000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1790391491.901376:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1790391491.901384:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cfe000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790391491.901394:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391491.901399:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790391491.901402:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9e52b5efb380) has no exports 00000020:00000080:0.0:1790391492.130223:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391492.130237:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1790391492.130243:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e52b5eae000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790391492.130247:0:15400:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5eae000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1790391492.130260:0:15400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1790391492.130372:0:15400:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e52b5ea9000 00000020:01000000:0.0:1790391492.130403:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1790391492.130407:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391492.130412:0:15400:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790391492.130416:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9e5290bf4d40) has no exports 00000100:00100000:0.0:1790391492.130543:0:10091:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e5182f3c000:10091] 3 exiting: rc = 0 00000100:00100000:0.0:1790391492.130652:0:6514:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e52a76e9c00:6514] 2 exiting: rc = 0 00000100:00100000:0.0:1790391492.130724:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e529e977000:6513] 1 exiting: rc = 0 00000100:00100000:1.0:1790391492.130920:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e529e977e00:6512] 0 exiting: rc = 1 00000100:00100000:0.0:1790391492.131323:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131331:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131337:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131343:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131349:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131355:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131361:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131367:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131373:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131379:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131384:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131707:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131713:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131717:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131722:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131738:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131743:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131747:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131752:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131757:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131762:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131767:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131772:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131777:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131782:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131787:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131791:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131797:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131802:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131806:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131812:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131818:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131823:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131828:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131834:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131839:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131844:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131849:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131854:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131859:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131864:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131869:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131874:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131907:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131913:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131919:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131924:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131929:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131934:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131938:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131951:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131957:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131963:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131968:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131974:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131980:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131985:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131991:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.131997:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.132003:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.132008:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.132013:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.132019:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.132024:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.142862:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e52a76e9200:6516] 1 exiting: rc = 0 00000100:00100000:2.0:1790391492.143279:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e52a76e9000:6515] 0 exiting: rc = 1 00000100:00100000:0.0:1790391492.143592:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143600:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143607:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143614:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143621:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143627:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143632:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143638:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143645:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143651:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143660:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143666:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143671:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143676:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143682:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143687:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143692:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143696:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143701:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143707:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143728:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143734:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143739:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143745:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143749:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143754:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143759:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143764:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143769:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143774:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143778:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143783:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143788:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143794:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143799:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143804:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143809:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143814:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143819:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143824:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143829:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143835:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143840:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143844:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143849:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143854:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143859:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143864:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143869:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.143873:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145350:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145359:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145365:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145370:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145376:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145450:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145459:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145474:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145479:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145483:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145488:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145493:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145498:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391492.145504:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.146510:0:7840:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9e52b9be6e00:7840] 2 exiting: rc = 0 00000100:00100000:1.0:1790391492.146983:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e52a76e9a00:6518] 1 exiting: rc = 0 00000100:00100000:3.0:1790391492.147411:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e52a76e8000:6517] 0 exiting: rc = 1 00000100:00100000:2.0:1790391492.147590:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147601:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147609:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147615:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147621:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147628:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147634:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147641:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147646:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147653:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147659:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147664:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147670:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147687:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147695:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147701:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147706:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147714:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147721:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147728:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147733:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147739:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147758:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147764:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147770:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147790:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147797:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147803:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147809:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147815:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147821:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147826:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147832:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147838:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147843:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147849:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147855:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.147874:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148697:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148702:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148709:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148715:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148722:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148728:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148735:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148741:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148747:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148754:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148760:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148782:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148791:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148796:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148803:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148809:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148815:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148820:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148826:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148843:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148849:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148855:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148862:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148867:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148895:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790391492.148912:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790391492.168981:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e52a76e8800:6520] 1 exiting: rc = 0 00000100:00100000:0.0:1790391492.169629:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e52a76e8200:6519] 0 exiting: rc = 1 00000100:00100000:3.0:1790391492.169866:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169874:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169909:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169914:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169919:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169924:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169929:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169934:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169939:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169944:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169949:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169954:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169959:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169965:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169970:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169975:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169980:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169985:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169989:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169994:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.169999:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170004:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170009:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170013:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170019:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170024:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170029:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170059:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170065:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170069:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170074:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170078:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170083:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170088:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170103:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170109:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170114:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170119:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170125:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170129:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170134:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170139:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170144:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170149:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170154:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170159:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170163:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170168:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170173:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170178:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170184:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170189:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170194:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170198:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170203:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170209:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170214:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170218:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170223:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170229:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170234:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170239:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170253:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170259:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.170634:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e52a76e8600:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1790391492.171281:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e52afc79a00:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1790391492.171381:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171397:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171403:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171408:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171412:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171418:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171425:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171430:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171436:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171442:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171447:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171451:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171456:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171470:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171476:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171481:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171486:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171491:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171496:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171501:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171506:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171511:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171516:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171521:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171525:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171530:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171536:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171540:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171544:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171549:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171554:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171559:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171577:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171582:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171588:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171592:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171597:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171601:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171606:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171611:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171616:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171620:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171625:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171631:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171635:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171640:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171645:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171649:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171655:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171660:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171665:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171672:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171677:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171681:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171686:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171692:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171696:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171701:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171706:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171711:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171716:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171721:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171726:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.171731:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172308:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e52a75fde00:6524] 1 exiting: rc = 0 00000100:00100000:1.0:1790391492.172440:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e52afc78c00:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1790391492.172764:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172771:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172785:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172791:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172796:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172801:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172806:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172812:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172818:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172823:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172829:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172834:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172840:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172846:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172851:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172856:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172862:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172867:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172872:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172908:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172914:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172919:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172925:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172931:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172936:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172942:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172947:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172953:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172958:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172964:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172970:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172975:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172980:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172985:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172990:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.172995:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173000:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173012:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173017:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173023:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173029:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173035:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173051:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173058:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173063:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173068:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173073:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173078:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173083:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173089:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173094:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173099:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173104:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173110:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173114:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173119:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173125:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173130:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173136:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173141:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173146:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173152:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173156:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173162:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.173684:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e52a75fcc00:6526] 1 exiting: rc = 0 00000100:00100000:3.0:1790391492.173870:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e52a75fc600:6527] 2 exiting: rc = 0 00000100:00100000:1.0:1790391492.174328:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e52a75fd600:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1790391492.174452:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174470:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174485:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174493:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174499:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174505:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174521:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174528:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174534:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174540:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174545:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174550:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174555:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174561:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174566:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174572:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174578:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174584:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174589:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174611:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174617:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174623:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174628:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174633:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174639:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174645:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174651:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174656:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174661:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174666:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174671:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174676:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174682:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174688:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174694:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174699:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174704:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174710:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174715:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174721:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174726:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174739:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174744:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174763:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174770:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174775:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174781:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174786:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174792:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174798:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174803:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174809:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174816:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174821:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174827:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174832:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174837:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174842:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174848:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174853:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174859:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174865:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174870:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391492.174944:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790391492.184234:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391492.184248:0:15400:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1790391492.184255:0:15400:0:(genops.c:885:class_export_put()) final put ffff9e5287620800/MDS_uuid 00000020:00000080:2.0:1790391492.184259:0:15400:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5287620800/MDS_uuid for MDS 00000020:01000000:2.0:1790391492.184269:0:15400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1790391492.184411:0:15400:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1790391492.555735:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391493.576231:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391494.600215:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391495.184419:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790391495.184429:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391495.184442:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790391495.184446:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790391495.184450:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e5181f62800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391495.184458:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 403 00000100:00080000:0.0:1790391495.184464:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790391495.184471:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5181f62800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391495.184511:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf94bb80 x1877361186480384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391495.184556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790391495.184560:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790391495.184562:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391495.184566:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 403 00000100:00080000:0.0:1790391495.184568:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790391495.184572:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e5182f5b000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391495.184582:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf949180 x1877361186480640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391495.184645:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186480512:0@lo:400:kworker.0 00000400:00000100:0.0:1790391495.184700:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186480512 offset 0 length 224: 4 00000100:00100000:0.0:1790391495.184768:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186480768:0@lo:400:kworker.0 00000400:00000100:0.0:1790391495.184786:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186480768 offset 0 length 224: 4 00000100:00100000:2.0:1790391495.185057:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186480384:0@lo:38:kworker.0 00000400:00000100:2.0:1790391495.185083:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186480384 offset 0 length 520: 4 00000100:00100000:2.0:1790391495.185101:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186480640:0@lo:38:kworker.0 00000400:00000100:2.0:1790391495.185115:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186480640 offset 0 length 520: 4 00010000:00010000:0.0:1790391495.625207:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790391496.016473:0:15601:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1790391496.032128:0:15601:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1790391496.032179:0:15601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391496.032192:0:15601:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391496.032199:0:15601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391496.032206:0:15601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391496.032243:0:15601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790391496.032249:0:15601:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790391496.032276:0:15601:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790391496.032290:0:15601:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bf94bb80 x1877361186480384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790391515 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391496.032308:0:15601:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790391496.032314:0:15601:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790391496.032320:0:15601:0:(import.c:65:import_set_state_nolock()) ffff9e5181f62800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790391496.032408:0:15601:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790391496.032413:0:15601:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bf94bb80 x1877361186480384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790391515 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391496.032422:0:15601:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790391496.032434:0:15601:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:3.0:1790391496.032499:0:13724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391496.032507:0:13724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391496.032514:0:13724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391496.032518:0:13724:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391496.032526:0:13724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391496.032543:0:13724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391496.032549:0:13724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790391496.032552:0:13724:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790391496.032554:0:13724:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790391496.032566:0:13724:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e52877fe000 00010000:00010000:3.0:1790391496.032569:0:13724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391496.032577:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5295144000/0x2b1b7949f13e0fa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e0faa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391496.032587:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391496.032589:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391496.032591:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391496.033135:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186480384:0@lo:38:kworker.0 00000100:00080000:3.0:1790391496.037085:0:15601:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790391496.037102:0:15601:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bf948380 x1877361186480512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391511 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391496.037166:0:15601:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790391496.037173:0:15601:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790391496.037198:0:15601:0:(import.c:65:import_set_state_nolock()) ffff9e5181f61000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790391496.037455:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1877361186480896:0@lo:39:umount.0 00000400:00000100:2.0:1790391496.037504:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186480896 offset 0 length 224: 4 00000100:00100000:0.0:1790391496.037587:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186480512:0@lo:400:kworker.0 00010000:00010000:3.0:1790391496.648006:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790391497.224084:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391497.224093:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391497.224096:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790391497.224100:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790391497.224407:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186481024:0@lo:400:kworker.0 00000400:00000100:0.0:1790391497.224493:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186481024 offset 0 length 224: 4 00010000:00010000:0.0:1790391497.675074:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790391497.738666:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790391497.738678:0:8421:0:(genops.c:885:class_export_put()) final put ffff9e52baf8e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790391497.738762:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52baf8e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790391497.738808:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52baf88800 for lustre-OST0000 00000001:00100000:0.0:1790391497.740611:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790391497.740621:0:9505:0:(genops.c:885:class_export_put()) final put ffff9e5182261800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790391497.740707:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182261800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1790391497.740755:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182265000 for lustre-OST0001 00010000:00010000:0.0:1790391498.696376:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391499.720075:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790391500.234774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790391500.234785:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790391500.234788:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790391500.234808:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790391500.235212:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391500.235238:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186481152:0@lo:400:kworker.0 00000400:00000100:1.0:1790391500.235294:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186481152 offset 0 length 224: 4 00010000:00010000:3.0:1790391500.745755:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391501.194062:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391491/real 1790391491] req@ffff9e5183b7e300 x1877361186480256/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790391501 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391501.194395:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5183b7e300 x1877361186480256/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790391501 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391501.194418:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52877fe000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391501.194445:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1790391501.194449:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3636:1877361186480256:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1790391501.194523:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790391501.194529:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1790391501.194531:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e52877fe000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391501.194537:0:8:0:(import.c:545:import_select_connection()) MGC192.168.202.128@tcp: connect to NID 0@lo last attempt 405 00000100:00080000:0.0:1790391501.194542:0:8:0:(import.c:630:import_select_connection()) MGC192.168.202.128@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790391501.194549:0:8:0:(import.c:665:import_select_connection()) MGC192.168.202.128@tcp: import ffff9e52877fe000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391501.194583:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf948380 x1877361186481280/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391501.194609:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790391501.194613:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391501.194875:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3636:1877361186481280:0@lo:250:kworker.0 00000400:00000100:2.0:1790391501.195011:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877361186481280 offset 0 length 520: 4 00000100:00100000:1.0:1790391501.195133:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186481408:0@lo:400:kworker.0 00000400:00000100:1.0:1790391501.195160:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186481408 offset 0 length 224: 4 00010000:00010000:0.0:1790391501.771198:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391502.800463:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391503.818022:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391504.842285:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391505.864193:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391506.312135:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391496/real 1790391496] req@ffff9e5183a42d80 x1877361186480896/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790391506 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391506.312170:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5183a42d80 x1877361186480896/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790391506 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391506.312190:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5181f61000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790391506.312212:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1877361186480896:0@lo:39:umount.0 00000100:00080000:3.0:1790391506.312310:0:15601:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790391506.312315:0:15601:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790391506.312320:0:15601:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790391506.313778:0:15601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391506.313796:0:15601:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391506.313804:0:15601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391506.313812:0:15601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391506.313835:0:15601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391506.313843:0:15601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391506.313851:0:15601:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391506.313856:0:15601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391506.313862:0:15601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391506.313979:0:15601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790391506.313984:0:15601:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1790391506.314141:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391506.314148:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391506.314155:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52813a3800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391506.314160:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391506.314168:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391506.314176:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391506.314182:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790391506.314184:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1790391506.314186:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1790391506.314199:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e52877fe000 00010000:00010000:0.0:1790391506.314203:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391506.314210:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52813a3800/0x2b1b7949f13e0fb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e0fb8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391506.314224:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391506.314227:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391506.314232:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391506.314242:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391506.314248:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391506.314254:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391506.314260:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790391506.314262:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790391506.314263:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790391506.314269:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e52877fe000 00010000:00010000:0.0:1790391506.314272:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391506.314277:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e1220 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e1227 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391506.314286:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391506.314288:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391506.314289:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790391506.314463:0:15601:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1790391506.314468:0:15601:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1790391506.314472:0:15601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391506.314478:0:15601:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790391506.314482:0:15601:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9e52b9aacd40) has no exports 00000020:00080000:3.0:1790391506.314504:0:15601:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9e52b9aacd40) has no exports 00010000:00010000:2.0:1790391506.314982:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790391506.321084:0:15601:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e51823573c0 - data ffff9e51818bd870/ffff9e518332e400 00000020:01000000:3.0:1790391506.321236:0:15601:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e52834234e0 - data ffff9e52a56c7798/ffff9e52b77a0000 00100000:10000000:3.0:1790391506.339301:0:15601:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790391506.348915:0:15601:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0cfc 00000020:00000080:2.0:1790391506.348927:0:15601:0:(genops.c:885:class_export_put()) final put ffff9e5181cc3000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790391506.348941:0:15601:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52b77e2800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790391506.348945:0:15601:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b77e2800 2 00000020:01000004:2.0:1790391506.348948:0:15601:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e52b77e2800 from lustre-OST0000 00000020:00000080:2.0:1790391506.348979:0:15601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391506.348990:0:15601:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1790391506.349102:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181cc3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790391506.349218:0:15601:0:(genops.c:885:class_export_put()) final put ffff9e52baf8c800/lustre-OST0000_UUID 00000020:00000080:2.0:1790391506.349221:0:15601:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52baf8c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790391506.349228:0:15601:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790391506.349273:0:15601:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790391506.349278:0:15601:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790391506.349281:0:15601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391506.349286:0:15601:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790391506.349293:0:15601:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e5181f66800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790391506.349299:0:15601:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9e529e97b380) has exports, disconnecting them 00000020:00080000:2.0:1790391506.349304:0:15601:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e5181f66800), last request at 1790391267 00000020:00000080:2.0:1790391506.349308:0:15601:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0d26 00000020:00080000:2.0:1790391506.349318:0:15601:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5181f66800): rc 0 00000020:00000080:2.0:1790391506.349323:0:15601:0:(genops.c:885:class_export_put()) final put ffff9e5181f66800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790391506.352337:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f66800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1790391506.352382:0:15601:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790391506.352387:0:15601:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790391506.352392:0:15601:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790391506.352397:0:15601:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790391506.352584:0:15601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391506.352594:0:15601:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1790391506.352600:0:15601:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790391506.352616:0:15601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391506.352620:0:15601:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790391506.352626:0:15601:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9e5181f66000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790391506.352631:0:15601:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9e529e97cd40) has exports, disconnecting them 00000020:00080000:0.0:1790391506.352634:0:15601:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9e5181f66000), last request at 1790391268 00000020:00000080:0.0:1790391506.352639:0:15601:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0d3b 00000020:00080000:0.0:1790391506.352654:0:15601:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5181f66000): rc 0 00000020:00000080:0.0:1790391506.352659:0:15601:0:(genops.c:885:class_export_put()) final put ffff9e5181f66000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790391506.353358:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5181f62800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790391506.353369:0:37:0:(genops.c:885:class_export_put()) final put ffff9e5181f64800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790391506.353371:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f64800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790391506.353381:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790391506.353440:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f66000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1790391506.353483:0:15601:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790391506.353486:0:15601:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790391506.353489:0:15601:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790391506.353493:0:15601:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790391506.353507:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5181f61000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790391506.353647:0:15601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391506.353652:0:15601:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1790391506.353655:0:15601:0:(genops.c:885:class_export_put()) final put ffff9e5181f62000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1790391506.353658:0:15601:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f62000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1790391506.353661:0:15601:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1790391506.353685:0:15601:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b77e2800 1 00000020:00000080:1.0:1790391506.353690:0:15601:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0cc4 00000020:00000080:1.0:1790391506.353694:0:15601:0:(genops.c:885:class_export_put()) final put ffff9e52b9a8b800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1790391506.353702:0:15601:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1790391506.353708:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9a8b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790391506.353717:0:15601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790391506.353721:0:15601:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790391506.353723:0:15601:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9e529e978000) has no exports 00000100:00080000:1.0:1790391506.440246:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790391506.440259:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391506.440262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790391506.440265:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790391506.440337:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391506.440354:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186481536:0@lo:400:kworker.0 00000400:00000100:1.0:1790391506.440407:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186481536 offset 0 length 224: 4 00000020:00000080:1.0:1790391506.453442:0:15601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790391506.453454:0:15601:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790391506.453470:0:15601:0:(genops.c:885:class_export_put()) final put ffff9e52b77e0000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790391506.453474:0:15601:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b77e0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790391506.453484:0:15601:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790391506.453601:0:15601:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e52b77e1000 00000020:02000400:1.0:1790391506.453645:0:15601:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1790391506.892129:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391507.912348:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391508.941084:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391509.967701:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790391509.987386:0:15803:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1790391510.007111:0:15803:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1790391510.007217:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391510.007234:0:15803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391510.007242:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391510.007250:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391510.007276:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790391510.007282:0:15803:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790391510.007321:0:15803:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790391510.007335:0:15803:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bf949180 x1877361186480640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790391515 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391510.007362:0:15803:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790391510.007372:0:15803:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790391510.007380:0:15803:0:(import.c:65:import_set_state_nolock()) ffff9e5182f5b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790391510.007384:0:15803:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790391510.007388:0:15803:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bf949180 x1877361186480640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790391515 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391510.007423:0:15803:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790391510.007429:0:15803:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:3.0:1790391510.007731:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391510.007740:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391510.007749:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52c21f7200 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391510.007753:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391510.007763:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391510.007771:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391510.007790:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790391510.007792:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790391510.007795:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790391510.007826:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e52877fe000 00010000:00010000:3.0:1790391510.007831:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391510.007838:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52c21f7200/0x2b1b7949f13e0f80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e0f87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391510.007850:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391510.007852:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391510.007855:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391510.008695:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186480640:0@lo:38:kworker.0 00000100:00080000:1.0:1790391510.012280:0:15803:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790391510.013214:0:15803:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bf94ad80 x1877361186480768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391511 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391510.013340:0:15803:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5284945180 x1877361186481024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391513 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391510.013361:0:15803:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5183a43100 x1877361186481152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391516 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391510.013380:0:15803:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e52bf948000 x1877361186481408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391517 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391510.013389:0:15803:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5183b7e300 x1877361186481536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391522 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391510.013396:0:15803:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1790391510.013593:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186481536:0@lo:400:kworker.0 00000100:00100000:3.0:1790391510.013603:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186481024:0@lo:400:kworker.0 00000100:00100000:0.0:1790391510.013714:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186481408:0@lo:400:kworker.0 00000100:00100000:0.0:1790391510.013721:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1877361186481152:0@lo:400:kworker.0 00000100:00080000:3.0:1790391510.021767:0:15803:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790391510.021959:0:15803:0:(import.c:65:import_set_state_nolock()) ffff9e52b9937000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790391510.022606:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1877361186481664:0@lo:39:umount.0 00000400:00000100:0.0:1790391510.022668:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877361186481664 offset 0 length 224: 4 00000100:00100000:2.0:1790391510.023036:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186480768:0@lo:400:kworker.0 00010000:00010000:0.0:1790391510.984268:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391511.560807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790391511.560819:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1790391512.009709:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391513.033056:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391514.056834:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391515.080866:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391516.107277:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391516.168090:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391501/real 1790391501] req@ffff9e52bf948380 x1877361186481280/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790391516 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391516.168193:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e52bf948380 x1877361186481280/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790391516 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391516.168215:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52877fe000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391516.168224:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1790391516.168229:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3636:1877361186481280:0@lo:250:kworker.0 00000100:00080000:3.0:1790391516.171401:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790391516.171412:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790391516.171416:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e52877fe000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391516.171424:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.128@tcp: connect to NID 0@lo last attempt 414 00000100:00080000:3.0:1790391516.171430:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.128@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790391516.171437:0:37:0:(import.c:665:import_select_connection()) MGC192.168.202.128@tcp: import ffff9e52877fe000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391516.171474:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183a42680 x1877361186481792/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391516.172732:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3636:1877361186481792:0@lo:250:kworker.0 00000400:00000100:2.0:1790391516.172810:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877361186481792 offset 0 length 520: 4 00010000:00010000:2.0:1790391517.128312:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391518.152063:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391519.176281:0:13725:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391520.200120:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391520.263987:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391510/real 1790391510] req@ffff9e5183a41500 x1877361186481664/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790391520 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391520.264013:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5183a41500 x1877361186481664/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790391520 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391520.264032:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b9937000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790391520.264051:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1877361186481664:0@lo:39:umount.0 00000100:00080000:3.0:1790391520.264747:0:15803:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790391520.264752:0:15803:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790391520.264757:0:15803:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790391520.265693:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391520.265706:0:15803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391520.265710:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391520.265714:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391520.265739:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391520.265744:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391520.265748:0:15803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391520.265751:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391520.265755:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391520.265924:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790391520.265929:0:15803:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1790391520.265950:0:15803:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1790391520.265955:0:15803:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1790391520.265959:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391520.265964:0:15803:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790391520.265977:0:15803:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9e52b5cacd40) has no exports 00000020:00080000:3.0:1790391520.266001:0:15803:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9e52b5cacd40) has no exports 00000020:01000000:3.0:1790391520.273109:0:15803:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e51823c6a80 - data ffff9e52a574f288/ffff9e5182c8dc00 00000020:01000000:3.0:1790391520.273620:0:15803:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e51823c6420 - data ffff9e52a5662ca8/ffff9e5182d3a000 00010000:00010000:0.0:1790391520.274069:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391520.274080:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391520.274091:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391520.274095:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391520.274104:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391520.274128:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391520.274134:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790391520.274137:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1790391520.274139:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1790391520.274154:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e52877fe000 00010000:00010000:0.0:1790391520.274158:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391520.274165:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e0f8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e0f95 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391520.274176:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391520.274180:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391520.274186:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391520.274188:0:6501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391520.274194:0:6501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391520.274225:0:6501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391520.274230:0:6501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790391520.274232:0:6501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790391520.274240:0:6501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790391520.274246:0:6501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e52877fe000 00010000:00010000:0.0:1790391520.274250:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391520.274256:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef600/0x2b1b7949f13e1212 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e1219 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391520.274270:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391520.274272:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391520.274274:0:6501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391520.274402:0:13724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790391520.284623:0:15803:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790391520.303541:0:15803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0e22 00000020:00000080:0.0:1790391520.303554:0:15803:0:(genops.c:885:class_export_put()) final put ffff9e5182260800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1790391520.303568:0:15803:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52bf9b4000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1790391520.303572:0:15803:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52bf9b4000 2 00000020:01000004:0.0:1790391520.303575:0:15803:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e52bf9b4000 from lustre-OST0001 00000020:00000080:0.0:1790391520.303598:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391520.303608:0:15803:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1790391520.303610:0:15803:0:(genops.c:885:class_export_put()) final put ffff9e5182261000/lustre-OST0001_UUID 00000020:00000080:0.0:1790391520.303613:0:15803:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182261000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1790391520.303619:0:15803:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1790391520.303739:0:15803:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c8c24317-3e12-4efa-bd41-8d3f5086c0ea->MGS 00010000:00010000:0.0:1790391520.303755:0:15803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e0b7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0b82 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391520.303766:0:15803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e0b7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0b82 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391520.303772:0:15803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1790391520.303775:0:15803:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1790391520.303778:0:15803:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1790391520.303791:0:15803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e52877fe000 00010000:00010000:0.0:1790391520.303802:0:15803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e0b7b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e0b82 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391520.303818:0:15803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52813a2800/0x2b1b7949f13e0ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2b1b7949f13e0ffe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391520.303825:0:15803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52813a2800/0x2b1b7949f13e0ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2b1b7949f13e0ffe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391520.303830:0:15803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790391520.303832:0:15803:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1790391520.303834:0:15803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1790391520.303848:0:15803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e52877fe000 00010000:00010000:0.0:1790391520.303851:0:15803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52813a2800/0x2b1b7949f13e0ff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2b1b7949f13e0ffe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790391520.303869:0:15803:0:(import.c:65:import_set_state_nolock()) ffff9e52877fe000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790391520.303872:0:15803:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000020:00000080:3.0:1790391520.304169:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182260800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1790391520.304388:0:15803:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790391520.304391:0:15803:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790391520.304396:0:15803:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790391520.304406:0:15803:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e5183a42680 x1877361186481792/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790391536 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790391520.304431:0:15803:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790391520.304434:0:15803:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1790391520.304560:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8c24317-3e12-4efa-bd41-8d3f5086c0ea:3636:1877361186481792:0@lo:250:kworker.0 10000000:01000000:0.0:1790391520.304626:0:15803:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790391520.304635:0:15803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0a78 00000020:00000080:0.0:1790391520.304640:0:15803:0:(genops.c:885:class_export_put()) final put ffff9e5287624000/c8c24317-3e12-4efa-bd41-8d3f5086c0ea 00000020:01000000:0.0:1790391520.304685:0:15803:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.128@tcp (flags='') 00000020:00000080:0.0:1790391520.304692:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391520.304698:0:15803:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.128@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790391520.304702:0:15803:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9e52ae8c99c0) has no exports 10000000:01000000:2.0:1790391520.304805:0:6509:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1790391520.305049:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5287624000/c8c24317-3e12-4efa-bd41-8d3f5086c0ea for MGC192.168.202.128@tcp 10000000:01000000:0.0:1790391520.305135:0:15803:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.128@tcp: client import never connected 00000100:00080000:0.0:1790391520.305138:0:15803:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1790391520.305141:0:15803:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790391520.305143:0:15803:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1790391520.305145:0:15803:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790391520.305312:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790391520.305318:0:15803:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.128@tcp (uuid c8c24317-3e12-4efa-bd41-8d3f5086c0ea) 00000020:01000000:0.0:1790391520.305325:0:15803:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790391520.305329:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790391520.305332:0:15803:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790391520.305337:0:15803:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e5182f5c000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790391520.305341:0:15803:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9e52b9d70000) has exports, disconnecting them 00000020:00080000:0.0:1790391520.305346:0:15803:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e5182f5c000), last request at 1790391290 00000020:00000080:0.0:1790391520.305350:0:15803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0e4c 00000020:00080000:0.0:1790391520.305361:0:15803:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5182f5c000): rc 0 00000020:00000080:0.0:1790391520.305365:0:15803:0:(genops.c:885:class_export_put()) final put ffff9e5182f5c000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790391520.310381:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52877fe000 for MGC192.168.202.128@tcp 00000020:00000080:2.0:1790391520.310402:0:8:0:(genops.c:885:class_export_put()) final put ffff9e52877f8000/c8c24317-3e12-4efa-bd41-8d3f5086c0ea 00000020:00000080:2.0:1790391520.310406:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52877f8000/c8c24317-3e12-4efa-bd41-8d3f5086c0ea for MGC192.168.202.128@tcp 00000020:01000000:2.0:1790391520.310420:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.128@tcp (c8c24317-3e12-4efa-bd41-8d3f5086c0ea) 00000020:00000080:2.0:1790391520.310744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5182f5c000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790391520.310813:0:15803:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790391520.310818:0:15803:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790391520.310822:0:15803:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790391520.310828:0:15803:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790391520.310849:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5182f5b000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790391520.311009:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790391520.311018:0:15803:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1790391520.311023:0:15803:0:(genops.c:885:class_export_put()) final put ffff9e52b5cff000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1790391520.311025:0:15803:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b5cff000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1790391520.311029:0:15803:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1790391520.311067:0:15803:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790391520.311080:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790391520.311085:0:15803:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790391520.311092:0:15803:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9e5181f67000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790391520.311098:0:15803:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9e529e9799c0) has exports, disconnecting them 00000020:00080000:2.0:1790391520.311102:0:15803:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9e5181f67000), last request at 1790391290 00000020:00000080:2.0:1790391520.311106:0:15803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0e61 00000020:00080000:2.0:1790391520.311120:0:15803:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e5181f67000): rc 0 00000020:00000080:2.0:1790391520.311126:0:15803:0:(genops.c:885:class_export_put()) final put ffff9e5181f67000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1790391520.311155:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f67000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1790391520.312211:0:15803:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1790391520.312282:0:15803:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790391520.312286:0:15803:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790391520.312291:0:15803:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790391520.312349:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e52b9937000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1790391520.312948:0:13725:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1790391520.313465:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1790391520.316956:0:6501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1790391520.342992:0:13724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1790391520.343219:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e528699b400:6495] 0 exiting: rc = 1 00000100:00100000:0.0:1790391520.343994:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e5288869800:6496] 1 exiting: rc = 0 00000100:00100000:3.0:1790391520.344163:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.344447:0:10388:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e5182f3fc00:10388] 3 exiting: rc = 0 00000100:00100000:3.0:1790391520.344512:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e52afc89800:6498] 1 exiting: rc = 0 00000100:00100000:3.0:1790391520.344579:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e529e941200:6497] 0 exiting: rc = 1 00000100:00100000:1.0:1790391520.346551:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e52afc88400:6499] 2 exiting: rc = 0 00000100:00100000:3.0:1790391520.352141:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352152:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352160:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352166:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352172:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352177:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352183:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352189:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352227:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352233:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352238:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352245:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352251:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352257:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352263:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352269:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352274:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352280:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352286:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352292:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352298:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352303:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352309:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352315:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352321:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352326:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352331:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352337:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352343:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352349:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352354:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352359:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352365:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352371:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352376:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352381:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352385:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352390:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352395:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352400:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352406:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352412:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352417:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352430:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352435:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352442:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352447:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352452:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352457:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352462:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352468:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352474:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352479:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352484:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352489:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352494:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352498:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352503:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352509:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352517:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352525:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352530:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352536:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.352543:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790391520.365404:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391520.365416:0:15803:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1790391520.365422:0:15803:0:(genops.c:885:class_export_put()) final put ffff9e5181f60000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1790391520.365427:0:15803:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f60000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1790391520.365435:0:15803:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1790391520.365484:0:15803:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52bf9b4000 1 00000020:00000080:3.0:1790391520.365491:0:15803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2b1b7949f13e0df1 00000020:00000080:3.0:1790391520.365497:0:15803:0:(genops.c:885:class_export_put()) final put ffff9e5181f64000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790391520.365510:0:15803:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790391520.365520:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5181f64000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1790391520.365530:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391520.365535:0:15803:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790391520.365547:0:15803:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9e52b9d719c0) has no exports 00000020:00000080:3.0:1790391520.483746:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391520.483760:0:15803:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1790391520.483765:0:15803:0:(genops.c:885:class_export_put()) final put ffff9e52bf9b2000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1790391520.483770:0:15803:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52bf9b2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1790391520.484003:0:15803:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1790391520.484550:0:15803:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e52bf9b4800 00000020:01000000:3.0:1790391520.484580:0:15803:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1790391520.484585:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790391520.484590:0:15803:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790391520.484594:0:15803:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9e52b9d73380) has no exports 00000020:00000080:3.0:1790391520.484614:0:15803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790391520.484620:0:15803:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1790391520.484624:0:15803:0:(genops.c:885:class_export_put()) final put ffff9e52b9a8b000/OSS_uuid 00000020:00000080:3.0:1790391520.484627:0:15803:0:(genops.c:844:class_export_destroy()) destroying export ffff9e52b9a8b000/OSS_uuid for OSS 00000020:01000000:3.0:1790391520.484630:0:15803:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1790391520.484722:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1790391520.484869:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e52b603ee00:8428] 1 exiting: rc = 0 00000100:00100000:0.0:1790391520.484956:0:10505:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9e51838a5a00:10505] 4 exiting: rc = 0 00000100:00100000:3.0:1790391520.485996:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e52b603c400:8427] 0 exiting: rc = 1 00000100:00100000:3.0:1790391520.486144:0:9796:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e518223e600:9796] 3 exiting: rc = 0 00000100:00100000:3.0:1790391520.488165:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e52b603f600:8429] 2 exiting: rc = 0 00000100:00100000:0.0:1790391520.488342:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488352:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488365:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488374:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488383:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488388:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488394:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488399:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488403:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488410:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488415:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488420:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488436:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488442:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488448:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488453:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488458:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488465:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488470:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488475:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488479:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488484:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488489:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488494:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488499:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488534:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488540:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488546:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488551:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488556:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488561:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488565:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488570:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488574:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488579:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488584:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488588:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488592:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488597:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488602:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488606:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488612:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488618:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488623:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488627:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488647:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488653:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488665:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488671:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488676:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488681:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488686:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488691:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488696:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488701:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488706:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488711:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488717:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488723:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488733:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488746:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488752:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488758:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.488763:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.490487:0:10518:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9e51838a4600:10518] 2 exiting: rc = 0 00000100:00100000:3.0:1790391520.490557:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e52896c0200:8431] 1 exiting: rc = 0 00000100:00100000:3.0:1790391520.490954:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e52ae9d0a00:8430] 0 exiting: rc = 1 00000100:00100000:0.0:1790391520.491147:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491164:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491170:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491175:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491180:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491186:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491206:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491333:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491341:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491346:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491351:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491357:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491363:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491368:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491374:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491379:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491385:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491391:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491408:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491413:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491418:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491423:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491428:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491433:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491438:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491443:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491448:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491454:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491459:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491464:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491469:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491474:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491480:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491486:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491491:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491496:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491501:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491505:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491510:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491514:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491519:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491524:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491529:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491534:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491539:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491544:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491550:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491555:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491560:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491565:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491570:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491575:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491579:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491591:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491597:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491602:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491608:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491613:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491618:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491623:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491628:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491633:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491638:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.491653:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.493153:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e52896c1400:8432] 0 exiting: rc = 1 00000100:00100000:3.0:1790391520.493542:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e52896c1200:8433] 1 exiting: rc = 0 00000100:00100000:2.0:1790391520.493767:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e52afefa200:8434] 2 exiting: rc = 0 00000100:00100000:0.0:1790391520.494160:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494170:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494177:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494182:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494188:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494345:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494355:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494361:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494367:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494373:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494379:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494386:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494392:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494413:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494420:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494425:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494431:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494437:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494443:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494448:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494453:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494460:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494465:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494471:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494489:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494495:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494500:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494506:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494513:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494521:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494527:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494533:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494538:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494544:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494551:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494556:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494562:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494586:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494593:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494598:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494604:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494610:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494617:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494624:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494630:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494636:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494643:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494649:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494655:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494662:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494669:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494677:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494682:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494689:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494695:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494700:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494705:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494711:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494716:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494731:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494738:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494744:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494750:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.494755:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790391520.503823:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e52b741f400:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1790391520.504350:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e52b741f000:8436] 1 exiting: rc = 0 00000100:00100000:0.0:1790391520.504415:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504423:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504428:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504433:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504438:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504443:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504447:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504453:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504458:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504463:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504468:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504473:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504478:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504483:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504490:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504496:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504502:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504507:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504512:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504517:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504522:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504527:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504532:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504538:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504544:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504549:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504554:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504559:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504565:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504585:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504591:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504596:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504602:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504608:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504614:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504621:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504627:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504633:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504641:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504650:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504656:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504666:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504674:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504686:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504692:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504701:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504708:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504716:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504722:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504729:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504734:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504739:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504745:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504749:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504754:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504760:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504766:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504771:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504791:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504798:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504803:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504809:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504815:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.504827:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.511913:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e52b9e0a400:8438] 1 exiting: rc = 0 00000100:00100000:3.0:1790391520.512240:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e52b7798800:8437] 0 exiting: rc = 1 00000100:00100000:0.0:1790391520.512461:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512469:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512494:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512502:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512508:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512515:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512521:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512526:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512531:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512536:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512542:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512550:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512555:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512561:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512584:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512590:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512595:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512601:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512606:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512611:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512616:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512621:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512626:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512631:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512636:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512641:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512660:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512668:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512676:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512681:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512687:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512693:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512699:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512706:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512725:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512731:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512737:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512742:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512762:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512768:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512773:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512846:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512853:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512860:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512866:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512872:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512909:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512915:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512920:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512926:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512949:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512957:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512965:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512972:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512980:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512987:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512993:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.512999:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.513005:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.513011:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.513018:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.513024:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.513045:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790391520.513128:0:15803:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790391520.528759:0:15803:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790391541.770096:0:16568:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790391552.402583:0:17181:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790391552.402589:0:17181:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1790391552.402591:0:17181:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790391552.402732:0:17181:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e5284dc3000 00000020:01000004:2.0:1790391552.402990:0:17181:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790391552.402999:0:17181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790391552.403013:0:17181:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e51833819c0) 00000020:00000080:2.0:1790391552.403032:0:17181:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790391552.484076:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.484353:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790391552.486744:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1790391552.487144:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.487439:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.487705:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.487965:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790391552.488283:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1790391552.488474:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790391552.488801:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.489093:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.489384:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790391552.489698:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.489913:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1790391552.493122:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.493540:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.493776:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.493969:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.494159:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.494517:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.494834:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.495129:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.495431:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.495768:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.495986:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.496171:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.496455:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.496738:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.496956:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.497176:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.497625:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.497871:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.498267:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.498538:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.498832:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.499088:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.499376:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.499642:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.499870:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.500160:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.500455:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.500801:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.501174:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.501534:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.501859:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790391552.502270:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.502568:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1790391552.504522:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.506500:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.507032:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.507637:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.508067:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1790391552.510263:0:17181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1790391552.514971:0:17181:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790391552.515216:0:17181:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790391552.515227:0:17181:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790391552.515241:0:17181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e2035 00000020:01000004:0.0:1790391552.515263:0:17181:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1790391552.515268:0:17181:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790391552.515274:0:17181:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e5284dc3000 from MGS 00000020:01000004:0.0:1790391552.515278:0:17181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790391552.515289:0:17181:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e52b9aab380) 00000020:00000080:0.0:1790391552.515301:0:17181:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790391552.515369:0:17181:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5284dc3000 from MGS, refs=2 00080000:01000000:0.0:1790391552.515374:0:17181:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790391552.515378:0:17181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e2043 00000100:00100000:0.0:1790391552.515477:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790391552.515610:0:17181:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790391552.515617:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790391552.517278:0:17181:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790391552.517289:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790391552.518385:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391552.518662:0:17181:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790391552.518668:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790391552.519529:0:17181:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790391552.519539:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790391552.520380:0:17181:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790391552.520389:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790391552.522183:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391552.522197:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391552.522200:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391552.522614:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391552.522617:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391552.522619:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391552.523370:0:17181:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790391552.526815:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790391552.528606:0:17181:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1790391552.529377:0:17193:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790391552.529416:0:17181:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790391552.529443:0:17181:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790391552.530198:0:17181:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790391552.530473:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391552.531009:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790391552.531022:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790391552.534242:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790391552.534254:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790391552.534872:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790391552.534913:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790391552.535596:0:17181:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790391552.535617:0:17181:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.128@tcp' 00000020:01000004:1.0:1790391552.535619:0:17181:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790391552.535650:0:17181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.128@tcp (typ=mgc) 00000020:00000080:1.0:1790391552.535662:0:17181:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.128@tcp (ffff9e52b5cacd40) 00000020:00000080:1.0:1790391552.535678:0:17181:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790391552.535774:0:17181:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5182260000@MGC192.168.202.128@tcp: add connection 192.168.202.128@tcp at head 00010000:00010000:1.0:1790391552.535961:0:17181:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.128@tcp-0 is initialized 00000040:01000000:1.0:1790391552.535967:0:17181:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 1 is initialized 00000100:00080000:0.0:1790391552.536463:0:17198:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1790391552.536967:0:17199:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790391552.537039:0:17181:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.128@tcp (uuid f157595d-6a80-4a0f-be35-35ee7e9fe29d) 00000020:00000080:1.0:1790391552.537063:0:17181:0:(genops.c:1385:class_connect()) connect: client f157595d-6a80-4a0f-be35-35ee7e9fe29d, cookie 0x2b1b7949f13e2051 00000100:00080000:1.0:1790391552.537078:0:17181:0:(import.c:545:import_select_connection()) MGC192.168.202.128@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391552.537085:0:17181:0:(import.c:665:import_select_connection()) MGC192.168.202.128@tcp: import ffff9e5182260000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391552.537125:0:17181:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183b7c000 x1877361186481920/t0(0) o250->MGC192.168.202.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391552.537161:0:17181:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f157595d-6a80-4a0f-be35-35ee7e9fe29d->MGS 00000020:01000004:1.0:1790391552.537191:0:17181:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790391552.537196:0:17181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790391552.537208:0:17181:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e52b5ca8000) 00000020:00000080:1.0:1790391552.537217:0:17181:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790391552.537758:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3636:1877361186481920:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790391552.537835:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391552.537944:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186481920 00000100:00100000:0.0:1790391552.537951:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186481920 00000100:00100000:0.0:1790391552.537979:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391552.537987:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1877361186481920:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790391552.538010:0:17194:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f157595d-6a80-4a0f-be35-35ee7e9fe29d@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:0.0:1790391552.538043:0:17194:0:(genops.c:1385:class_connect()) connect: client f157595d-6a80-4a0f-be35-35ee7e9fe29d, cookie 0x2b1b7949f13e205f 00000100:00080000:0.0:1790391552.538171:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9e5287d58800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391552.538235:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+5:3636:x1877361186481920:12345-0@lo:250:mount.lustre.0 Request processed in 247us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391552.538242:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391552.538289:0:3636:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.128@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790391552.538298:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.128@tcp: connect to target with instance 0 00000100:00080000:0.0:1790391552.538306:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.128@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790391552.538310:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790391552.538313:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182260000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790391552.538316:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790391552.538325:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790391552.538329:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3636:1877361186481920:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790391552.549783:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391552.551415:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790391552.551423:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790391552.555321:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790391552.555334:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790391552.562246:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790391552.562260:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790391552.563166:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391552.563350:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790391552.563356:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790391552.564415:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790391552.564425:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790391552.600089:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391552.600389:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790391552.600397:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790391552.602259:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790391552.602273:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790391552.603147:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391552.603399:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790391552.603405:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790391552.604104:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790391552.604112:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790391552.608427:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391552.608722:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790391552.608728:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790391552.609414:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790391552.609422:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790391552.610300:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391552.610462:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790391552.610472:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790391552.611269:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790391552.611276:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790391552.630337:0:17181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790391552.630684:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790391552.630692:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790391552.632269:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790391552.632283:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790391552.633362:0:17181:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790391552.633372:0:17181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790391552.634725:0:17181:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790391552.634759:0:17181:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1790391552.634767:0:17181:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790391552.634990:0:17181:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790391552.635035:0:17181:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.128@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1790391552.635041:0:17181:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790391552.635042:0:17181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391552.635047:0:17181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391552.635048:0:17181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391552.635049:0:17181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391552.635051:0:17181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391552.635052:0:17181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391552.635053:0:17181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391552.635055:0:17181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391552.635056:0:17181:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790391552.635058:0:17181:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1790391552.635060:0:17181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790391552.635061:0:17181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391552.635062:0:17181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391552.635063:0:17181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391552.635064:0:17181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391552.635065:0:17181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391552.635066:0:17181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391552.635067:0:17181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391552.635068:0:17181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391552.635069:0:17181:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790391552.635097:0:17181:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790391552.635125:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482048:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790391552.635308:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391552.635409:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391552.635616:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186482048 00000100:00100000:0.0:1790391552.635626:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186482048 00000100:00100000:0.0:1790391552.635704:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391552.635717:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+5:17181:x1877361186482048:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790391552.635771:0:17197:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790391552.635775:0:17197:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790391552.635778:0:17197:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790391552.636320:0:17217:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790391552.636821:0:17197:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1790391552.638992:0:17218:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790391552.639000:0:17218:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1790391552.639003:0:17218:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790391552.639006:0:17218:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790391552.639164:0:17218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1790391552.639436:0:17197:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790391552.639448:0:17197:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790391552.641197:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+5:17181:x1877361186482048:12345-0@lo:253:mount.lustre.0 Request processed in 5462us (5868us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391552.641220:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391552.641382:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482048:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790391552.641404:0:17181:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790391552.641407:0:17181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790391552.641409:0:17181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391552.641410:0:17181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391552.641412:0:17181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391552.641413:0:17181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391552.641414:0:17181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391552.641415:0:17181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391552.641427:0:17181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391552.641428:0:17181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391552.641429:0:17181:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790391552.641451:0:17181:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e5284dc3000 from lustre-MDT0000 10000000:01000000:1.0:1790391552.641537:0:17181:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790391552.641541:0:17181:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790391552.641612:0:17181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e52b5cacd40 10000000:01000000:1.0:1790391552.641618:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790391552.641628:0:17181:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e52b5cacd40 from 1 10000000:01000000:1.0:1790391552.641631:0:17181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790391552.641667:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.641678:0:17181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.641689:0:17181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391552.641708:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790391552.641764:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391552.641840:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391552.642075:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186482176 00000100:00100000:2.0:1790391552.642083:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186482176 00000100:00100000:2.0:1790391552.642156:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391552.642166:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+5:17181:x1877361186482176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391552.642178:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391552.642203:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184055e00/0x2b1b7949f13e206d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2066 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.642227:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184055e00/0x2b1b7949f13e206d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2066 expref: 6 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.642238:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184055e00/0x2b1b7949f13e206d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2066 expref: 6 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.642248:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055e00, rc 0) 00000100:00100000:2.0:1790391552.642296:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+6:17181:x1877361186482176:12345-0@lo:101:mount.lustre.0 Request processed in 131us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391552.642309:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391552.642383:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391552.642417:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.642426:0:17181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391552.642866:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391552.642939:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.643153:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.643238:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186482304 00000100:00100000:1.0:1790391552.643243:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186482304 00000100:00100000:1.0:1790391552.643268:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391552.643274:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+6:17181:x1877361186482304:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391552.643400:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+6:17181:x1877361186482304:12345-0@lo:501:mount.lustre.0 Request processed in 125us (459us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790391552.643407:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391552.643454:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482304:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790391552.643541:0:17181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790391552.644073:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.644083:0:17181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391552.644092:0:17181:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e5284dc3000 10000000:01000000:3.0:1790391552.644097:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790391552.644101:0:17181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e5284dc3000 10000000:01000000:3.0:1790391552.644104:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790391552.644107:0:17181:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e5284dc3000 from 1 10000000:01000000:3.0:1790391552.644109:0:17181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790391552.644136:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.644144:0:17181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.644167:0:17181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391552.644181:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391552.644304:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.644668:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.645422:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186482432 00000100:00100000:1.0:1790391552.645442:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186482432 00000100:00100000:1.0:1790391552.645519:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391552.645528:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+6:17181:x1877361186482432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391552.645656:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391552.645679:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5183087e00/0x2b1b7949f13e207b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2074 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.645705:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183087e00/0x2b1b7949f13e207b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2074 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.645716:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5183087e00/0x2b1b7949f13e207b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2074 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.645725:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087e00, rc 0) 00000100:00100000:1.0:1790391552.645791:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+7:17181:x1877361186482432:12345-0@lo:101:mount.lustre.0 Request processed in 263us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.645797:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790391552.645931:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391552.645949:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.645959:0:17181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391552.645977:0:17181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790391552.645992:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.646000:0:17181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b763c800/0x2b1b7949f13e2074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e207b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391552.646007:0:17181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790391552.646011:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391552.646016:0:17181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e5284dc3000 10000000:01000000:3.0:1790391552.646019:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790391552.646022:0:17181:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790391552.646026:0:17181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790391552.646048:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.646062:0:17181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.646070:0:17181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391552.646091:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391552.646122:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.646146:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.646234:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186482560 00000100:00100000:1.0:1790391552.646239:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186482560 00000100:00100000:1.0:1790391552.646260:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391552.646266:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+7:17181:x1877361186482560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391552.646273:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391552.646281:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5183086200/0x2b1b7949f13e2089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2082 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.646295:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183086200/0x2b1b7949f13e2089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2082 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.646303:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5183086200/0x2b1b7949f13e2089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2082 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.646315:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086200, rc 0) 00000100:00100000:1.0:1790391552.646340:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+8:17181:x1877361186482560:12345-0@lo:101:mount.lustre.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.646346:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391552.646488:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391552.646500:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.646507:0:17181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391552.646571:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391552.646597:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.646621:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.646772:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186482688 00000100:00100000:1.0:1790391552.646776:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186482688 00000100:00100000:1.0:1790391552.646795:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391552.646801:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+8:17181:x1877361186482688:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391552.646973:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+9:17181:x1877361186482688:12345-0@lo:501:mount.lustre.0 Request processed in 171us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.646980:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391552.647106:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391552.647135:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391552.647175:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.647297:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.649358:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186482816 00000100:00100000:1.0:1790391552.649372:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186482816 00000100:00100000:1.0:1790391552.649435:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391552.649448:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+9:17181:x1877361186482816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391552.650579:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+9:17181:x1877361186482816:12345-0@lo:503:mount.lustre.0 Request processed in 1129us (3397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.650591:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391552.650919:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186482816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391552.651448:0:17219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17219:1877361186482944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391552.651633:0:17219:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.651670:0:17219:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290382d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391552.651721:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186482944 00000100:00100000:2.0:1790391552.651727:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186482944 00000100:00100000:2.0:1790391552.651768:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391552.651777:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+9:17219:x1877361186482944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391552.652366:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+9:17219:x1877361186482944:12345-0@lo:502:llog_process_th.0 Request processed in 589us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391552.652374:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790391552.652635:0:17219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17219:1877361186482944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391552.652666:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391552.652676:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.652679:0:17219:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790391552.652684:0:17219:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790391552.652687:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391552.652700:0:17219:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e529e9799c0) 00000020:00000080:3.0:1790391552.652715:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790391552.652720:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790391552.652789:0:17219:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790391552.652796:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e2097 00000020:00000080:3.0:1790391552.653009:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790391552.653013:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391552.653016:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.653018:0:17219:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790391552.653020:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391552.653023:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.653025:0:17219:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790391552.653028:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391552.653035:0:17219:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e529e978000) 00000020:00000080:3.0:1790391552.653043:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790391552.653047:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790391552.653049:0:17219:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790391552.653052:0:17219:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790391552.653057:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790391552.653103:0:17219:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5284dc3000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790391552.653115:0:17219:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e529e97cd40) 00000020:00000080:3.0:1790391552.653123:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790391552.653177:0:17219:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790391552.653256:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e20ac 00000020:00000080:3.0:1790391552.653347:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790391552.653352:0:17219:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790391552.653356:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2b1b7949f13e20b3 00080000:01000000:3.0:1790391552.653361:0:17219:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790391552.653364:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e20ba 00010000:00010000:3.0:1790391552.730017:0:17219:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790391552.730729:0:17219:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1790391552.731116:0:17219:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790391552.732016:0:17219:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e529e97b380) 00000020:00000080:3.0:1790391552.732041:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790391552.732152:0:17219:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790391552.732161:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e20c8 00000020:00000080:3.0:1790391552.732668:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790391552.736743:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2b1b7949f13e20cf 00000020:00000080:3.0:1790391552.739089:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790391552.739106:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391552.739113:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.739116:0:17219:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790391552.739119:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790391552.739122:0:17219:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1790391552.739124:0:17219:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790391552.739126:0:17219:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790391552.739128:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790391552.739131:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.739133:0:17219:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790391552.739135:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391552.739140:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.739142:0:17219:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790391552.739147:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790391552.739194:0:17219:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790391552.739209:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391552.739213:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.739224:0:17219:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790391552.739227:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391552.739231:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.739232:0:17219:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1790391552.739235:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790391552.739241:0:17219:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:00000080:3.0:1790391552.739271:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391552.739288:0:17219:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9e52b5efb380) 00000020:00000080:3.0:1790391552.739305:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790391552.739310:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790391552.739362:0:17219:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1790391552.739368:0:17219:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790391552.739386:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e20dd 00010000:00080000:3.0:1790391552.739416:0:17219:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5284eef000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391552.745109:0:17219:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1790391552.746357:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790391552.746374:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790391552.746422:0:17219:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790391552.746445:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e20e4 00000100:00080000:2.0:1790391552.746456:0:17219:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391552.746462:0:17219:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e5284eef000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391552.746513:0:17219:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5284944e00 x1877361186483072/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391552.746538:0:17219:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1790391552.746859:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391552.746863:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391552.746866:0:17219:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1790391552.746869:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790391552.746872:0:17219:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1790391552.746873:0:17219:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391552.746914:0:17219:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391552.746916:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790391552.746920:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391552.746922:0:17219:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790391552.746925:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790391552.746930:0:17219:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790391552.746942:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391552.746943:0:17219:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790391552.746947:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790391552.746951:0:17219:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:2.0:1790391552.746976:0:17219:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790391552.746979:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391552.746994:0:17219:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e5183380000) 00000020:00000080:2.0:1790391552.747006:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1790391552.747010:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790391552.747074:0:17219:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790391552.747080:0:17219:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790391552.747085:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e20f2 00010000:00080000:2.0:1790391552.747113:0:17219:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5183375000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391552.747333:0:17219:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1790391552.747926:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186483072:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391552.748004:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.748313:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186483072 00000100:00100000:3.0:1790391552.748322:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186483072 00000100:00100000:3.0:1790391552.748361:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391552.748368:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186483072:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1790391552.748390:0:17206:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1790391552.751037:0:17219:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790391552.752810:0:17219:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790391552.760739:0:17219:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391552.762347:0:17219:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1790391552.773774:0:17219:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1790391552.780694:0:17225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790391552.780703:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1790391552.783773:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186483072:12345-0@lo:38:llog_process_th.0 Request processed in 35394us (35758us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790391552.783787:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:3.0:1790391552.784969:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790391552.784983:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790391552.785020:0:17219:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790391552.785039:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e20f9 00000100:00080000:3.0:1790391552.785047:0:17219:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790391552.785053:0:17219:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5183375000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391552.785086:0:17219:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183a42680 x1877361186483200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391552.785107:0:17219:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1790391552.785158:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391552.785163:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.785165:0:17219:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790391552.785168:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790391552.785171:0:17219:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1790391552.785173:0:17219:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790391552.785174:0:17219:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790391552.785588:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790391552.785595:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.785596:0:17219:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790391552.785601:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790391552.785605:0:17219:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1790391552.785609:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.785611:0:17219:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790391552.785614:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790391552.785618:0:17219:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:3.0:1790391552.785641:0:17219:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790391552.785644:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391552.785656:0:17219:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e52b5ef8000) 00000020:00000080:3.0:1790391552.785668:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1790391552.785673:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790391552.785730:0:17219:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790391552.785735:0:17219:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1790391552.785741:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2b1b7949f13e2107 00010000:00080000:3.0:1790391552.785770:0:17219:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5183835000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391552.786099:0:17219:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1790391552.786163:0:17219:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790391552.786294:0:17219:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:1.0:1790391552.786581:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391552.786588:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790391552.786592:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186483072:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391552.786618:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186483200:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790391552.786673:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186483200 offset 0 length 520: 4 00000040:00080000:3.0:1790391552.788608:0:17219:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391552.788808:0:17219:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1790391552.791123:0:17219:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1790391552.791872:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790391552.791983:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790391552.793604:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790391552.793616:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790391552.793663:0:17219:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790391552.793684:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e210e 00000100:00080000:2.0:1790391552.793694:0:17219:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391552.793700:0:17219:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5183835000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391552.793737:0:17219:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5284945500 x1877361186483328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391552.793798:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186483328:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790391552.793854:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186483328 offset 0 length 520: 4 00000100:00080000:2.0:1790391552.793952:0:17219:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790391552.794027:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391552.794031:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391552.794033:0:17219:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790391552.794036:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391552.794041:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391552.794042:0:17219:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790391552.794045:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391552.794047:0:17219:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790391552.794049:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391552.794051:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391552.794052:0:17219:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790391552.794054:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391552.794057:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391552.794058:0:17219:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790391552.794062:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790391552.794089:0:17219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17219:1877361186483456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391552.794137:0:17219:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391552.794193:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186483456 00000100:00100000:2.0:1790391552.794200:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186483456 00000100:00100000:2.0:1790391552.794241:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391552.794250:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+9:17219:x1877361186483456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391552.794357:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+9:17219:x1877361186483456:12345-0@lo:502:llog_process_th.0 Request processed in 108us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391552.794365:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391552.794413:0:17219:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727900 going to sleep for 11 seconds 00000100:00100000:2.0:1790391552.794432:0:17219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17219:1877361186483456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790391552.794454:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391552.794459:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391552.794461:0:17219:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790391552.794465:0:17219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1790391552.794538:0:17181:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1790391552.794557:0:17181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790391552.794572:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.794583:0:17181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b763da00/0x2b1b7949f13e2082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2089 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391552.794591:0:17181:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5284dc3000 from 1 10000000:01000000:2.0:1790391552.794594:0:17181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391552.794620:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.794629:0:17181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.794637:0:17181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391552.794650:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186483584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391552.794677:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391552.794691:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391552.795643:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186483584 00000100:00100000:0.0:1790391552.795653:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186483584 00000100:00100000:0.0:1790391552.795699:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391552.795710:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+9:17181:x1877361186483584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391552.795721:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391552.795740:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eefc00/0x2b1b7949f13e211c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2115 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.795765:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eefc00/0x2b1b7949f13e211c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2115 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.795775:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eefc00/0x2b1b7949f13e211c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2115 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.795784:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefc00, rc 0) 00000100:00100000:0.0:1790391552.795841:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+10:17181:x1877361186483584:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391552.795861:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391552.795976:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186483584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391552.795992:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.796002:0:17181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391552.796713:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186483712:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790391552.796756:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.796789:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391552.796869:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186483712 00000100:00100000:2.0:1790391552.796891:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186483712 00000100:00100000:2.0:1790391552.796929:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790391552.796936:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+10:17181:x1877361186483712:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790391552.796953:0:17197:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790391552.796960:0:17197:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790391552.797113:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+10:17181:x1877361186483712:12345-0@lo:256:mount.lustre.0 Request processed in 177us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391552.797131:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391552.797441:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186483712:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790391552.798085:0:17181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391552.798108:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.798119:0:17181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391552.798127:0:17181:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5284dc3000 from 1 10000000:01000000:3.0:1790391552.798130:0:17181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391552.798161:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.798169:0:17181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.798655:0:17181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391552.798749:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186483840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391552.798801:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.798870:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391552.799035:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186483840 00000100:00100000:2.0:1790391552.799042:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186483840 00000100:00100000:2.0:1790391552.799120:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391552.799130:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+10:17181:x1877361186483840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391552.799141:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391552.799156:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e212a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2123 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.799189:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e212a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2123 expref: 11 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.799201:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e212a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2123 expref: 11 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.799208:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055800, rc 0) 00000100:00100000:2.0:1790391552.799251:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17181:x1877361186483840:12345-0@lo:101:mount.lustre.0 Request processed in 122us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391552.799258:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391552.799329:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186483840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391552.799343:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.799352:0:17181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391552.799424:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186483968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391552.799448:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.799810:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391552.799841:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186483968 00000100:00100000:0.0:1790391552.799846:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186483968 00000100:00100000:2.0:1790391552.799921:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391552.799928:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17181:x1877361186483968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391552.800059:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17181:x1877361186483968:12345-0@lo:501:mount.lustre.0 Request processed in 132us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391552.800065:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391552.800133:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186483968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391552.800164:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186484096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391552.800221:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.800584:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.800612:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186484096 00000100:00100000:1.0:1790391552.800616:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186484096 00000100:00100000:1.0:1790391552.800639:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391552.800646:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17181:x1877361186484096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391552.800738:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17181:x1877361186484096:12345-0@lo:503:mount.lustre.0 Request processed in 93us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.800745:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391552.800811:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186484096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391552.801350:0:17229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17229:1877361186484224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391552.801394:0:17229:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.801421:0:17229:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.801564:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186484224 00000100:00100000:1.0:1790391552.801569:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186484224 00000100:00100000:1.0:1790391552.801590:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391552.801596:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17229:x1877361186484224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391552.802163:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17229:x1877361186484224:12345-0@lo:502:llog_process_th.0 Request processed in 565us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.802171:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790391552.802427:0:17229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17229:1877361186484224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391552.802457:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391552.802473:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.802476:0:17229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790391552.802671:0:17229:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5284dc3000 00000020:00000080:3.0:1790391552.802674:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391552.802681:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391552.802684:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.802685:0:17229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790391552.802688:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391552.802690:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.802691:0:17229:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790391552.802694:0:17229:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5284dc3000 00000020:00000080:3.0:1790391552.802696:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391552.802767:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391552.802770:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.802772:0:17229:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790391552.802775:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391552.802777:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.802778:0:17229:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790391552.802781:0:17229:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5284dc3000 00000020:00000080:3.0:1790391552.802783:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790391552.802800:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391552.802802:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.802804:0:17229:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790391552.802806:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391552.802809:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.802810:0:17229:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790391552.802814:0:17229:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5284dc3000 00000020:00000080:3.0:1790391552.802816:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790391552.802857:0:17229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17229:1877361186484352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790391552.802938:0:17229:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391552.802965:0:17229:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.803044:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186484352 00000100:00100000:1.0:1790391552.803050:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186484352 00000100:00100000:1.0:1790391552.803076:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391552.803083:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17229:x1877361186484352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391552.803164:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17229:x1877361186484352:12345-0@lo:502:llog_process_th.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.803171:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790391552.804599:0:17229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17229:1877361186484352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790391552.804643:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391552.804649:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391552.804651:0:17229:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790391552.804655:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1790391552.808994:0:17181:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790391552.809033:0:17181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391552.809062:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.809076:0:17181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391552.809137:0:17181:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790391552.809141:0:17181:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e5284dc3000 10000000:01000000:0.0:1790391552.809144:0:17181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e5284dc3000 10000000:01000000:0.0:1790391552.809148:0:17181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790391552.809154:0:17181:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5284dc3000 from 1 10000000:01000000:0.0:1790391552.809157:0:17181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790391552.809559:0:17181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.809568:0:17181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.809579:0:17181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391552.809605:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186484480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391552.809670:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391552.809707:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391552.813342:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186484480 00000100:00100000:0.0:1790391552.813359:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186484480 00000100:00100000:0.0:1790391552.813533:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790391552.813545:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17181:x1877361186484480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391552.813562:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391552.813581:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e2138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2131 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.813608:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e2138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2131 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.813619:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eeea00/0x2b1b7949f13e2138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2131 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.813628:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eeea00, rc 0) 00000100:00100000:0.0:1790391552.813702:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17181:x1877361186484480:12345-0@lo:101:mount.lustre.0 Request processed in 160us (4031us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391552.813709:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790391552.813767:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186484480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391552.813787:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.813797:0:17181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391552.813873:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186484608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391552.814565:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391552.814601:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f22180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391552.815337:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186484608 00000100:00100000:0.0:1790391552.815344:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186484608 00000100:00100000:0.0:1790391552.815931:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790391552.815944:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17181:x1877361186484608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391552.816090:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17181:x1877361186484608:12345-0@lo:501:mount.lustre.0 Request processed in 149us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391552.816097:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790391552.816149:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186484608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391552.817575:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186484736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391552.817642:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391552.817676:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f22180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391552.817716:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186484736 00000100:00100000:0.0:1790391552.817722:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186484736 00000100:00100000:0.0:1790391552.817761:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391552.817770:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17181:x1877361186484736:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391552.817865:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17181:x1877361186484736:12345-0@lo:503:mount.lustre.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391552.817873:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391552.817948:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186484736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391552.820465:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17232:1877361186484864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790391552.820600:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391552.820654:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7727540 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.821001:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186484864 00000100:00100000:1.0:1790391552.821016:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186484864 00000100:00100000:1.0:1790391552.821066:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790391552.821075:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17232:x1877361186484864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391552.821496:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17232:x1877361186484864:12345-0@lo:502:llog_process_th.0 Request processed in 421us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.821504:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790391552.821566:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17232:1877361186484864:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1790391552.821627:0:17232:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790391552.821642:0:17232:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e52b5cab380) 00000020:00000080:1.0:1790391552.821659:0:17232:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1790391552.821735:0:17232:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5284dc3000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790391552.821738:0:17232:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5284dc3000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790391552.821741:0:17232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5284dc3000 4 00010000:00080000:1.0:1790391552.821768:0:17232:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5284ed9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.128@tcp at head 00010000:00010000:1.0:1790391552.832607:0:17232:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1790391552.841032:0:17232:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790391552.841078:0:17232:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790391552.841093:0:17232:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2b1b7949f13e2146 00000100:00080000:1.0:1790391552.841104:0:17232:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391552.841111:0:17232:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e5284ed9800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391552.841166:0:17232:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183b7df80 x1877361186484992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391552.841214:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186484992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391552.841280:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391552.841350:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186484992 00000100:00100000:1.0:1790391552.841358:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186484992 00000100:00100000:1.0:1790391552.841391:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391552.841406:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186484992:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391552.841465:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1877361186484992:12345-0@lo:38:llog_process_th.0 Request processed in 58us (183us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790391552.841473:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790391552.843961:0:17232:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790391552.844986:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391552.845000:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5284ed9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391552.845008:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790391552.845012:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186484992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391552.845808:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17232:1877361186485120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391552.845918:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391552.845960:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186485120 00000100:00100000:1.0:1790391552.845967:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186485120 00000100:00100000:1.0:1790391552.846003:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790391552.846010:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17232:x1877361186485120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391552.846114:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17232:x1877361186485120:12345-0@lo:502:llog_process_th.0 Request processed in 104us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.846122:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790391552.846166:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.846270:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17232:1877361186485120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391552.846308:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17232:1877361186485248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391552.846339:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391552.846358:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186485248 00000100:00100000:1.0:1790391552.846361:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186485248 00000100:00100000:1.0:1790391552.846447:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391552.846453:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17232:x1877361186485248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790391552.846511:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17232:x1877361186485248:12345-0@lo:502:llog_process_th.0 Request processed in 57us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.846518:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391552.846545:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.846556:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17232:1877361186485248:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790391552.846574:0:17232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1790391552.846642:0:17181:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790391552.846667:0:17181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790391552.846684:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.846695:0:17181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee800/0x2b1b7949f13e2131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2138 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790391552.846742:0:17181:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790391552.846745:0:17181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391552.846747:0:17181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391552.846749:0:17181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391552.846750:0:17181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391552.846752:0:17181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391552.846753:0:17181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391552.846755:0:17181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391552.846757:0:17181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391552.846759:0:17181:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790391552.846763:0:17181:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1790391552.846766:0:17181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790391552.846767:0:17181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391552.846769:0:17181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391552.846770:0:17181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391552.846771:0:17181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391552.846772:0:17181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391552.846773:0:17181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391552.846774:0:17181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391552.846779:0:17181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391552.846780:0:17181:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790391552.846793:0:17181:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790391552.846802:0:17181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186485376:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790391552.846831:0:17181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391552.846844:0:17181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.846866:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186485376 00000100:00100000:1.0:1790391552.846870:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186485376 00000100:00100000:1.0:1790391552.846922:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391552.846929:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17181:x1877361186485376:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790391552.846948:0:17196:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790391552.846964:0:17196:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790391552.849363:0:17196:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790391552.849444:0:17196:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790391552.849741:0:17217:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790391552.849745:0:17217:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790391552.849831:0:17217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.849849:0:17217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eefc00/0x2b1b7949f13e211c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2115 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.849858:0:17217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.849987:0:17217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eefc00/0x2b1b7949f13e211c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2115 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391552.850001:0:17217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52b5eefc00/0x2b1b7949f13e211c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2115 expref: 12 pid: 17194 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391552.850015:0:17217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186485504:0@lo:104: 00000100:00100000:1.0:1790391552.850084:0:17217:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391552.850162:0:17217:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52a7685840 going to sleep for 11 seconds 00000100:00100000:1.0:1790391552.850354:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17181:x1877361186485376:12345-0@lo:253:mount.lustre.0 Request processed in 3423us (3519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391552.850364:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391552.850853:0:17181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17181:1877361186485376:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790391552.850867:0:17181:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790391552.850870:0:17181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790391552.850873:0:17181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790391552.850875:0:17181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391552.850907:0:17181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391552.850908:0:17181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391552.850910:0:17181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391552.850911:0:17181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391552.850913:0:17181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790391552.850915:0:17181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391552.850916:0:17181:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790391552.850935:0:17181:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1790391552.853004:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186485504 00000100:00100000:0.0:1790391552.853016:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186485504 00000100:00100000:0.0:1790391552.853073:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391552.853084:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:17217:x1877361186485504:12345-0@lo:104: 00010000:00010000:0.0:1790391552.853105:0:17185:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391552.853865:0:17185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1790391552.853873:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790391552.853906:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:17217:x1877361186485504:12345-0@lo:104: Request processed in 793us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391552.853916:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391552.853923:0:17217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186485504:0@lo:104: 00010000:00010000:3.0:1790391552.853956:0:17217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.858365:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.858379:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054c00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391552.858384:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.858395:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391552.858403:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391552.858409:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391552.858471:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.858476:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391552.858511:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.858519:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5184054c00/0x2b1b7949f13e2115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e211c expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.858543:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391552.858545:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391552.858548:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391552.858559:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186485632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391552.859054:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391552.859461:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186485632 00000100:00100000:2.0:1790391552.859468:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186485632 00010000:00010000:2.0:1790391552.859497:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eefc00/0x2b1b7949f13e211c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2115 expref: 12 pid: 17194 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391552.859536:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391552.859547:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:3638:x1877361186485632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391552.859561:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391552.859568:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eefc00/0x2b1b7949f13e211c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2115 expref: 12 pid: 17194 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859581:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eefc00/0x2b1b7949f13e211c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2115 expref: 12 pid: 17194 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859597:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eefc00/0x2b1b7949f13e211c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2115 expref: 12 pid: 17194 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859613:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859621:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790391552.859635:0:17187:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009889659s 00010000:00010000:2.0:1790391552.859640:0:17187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859647:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859654:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859662:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859674:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391552.859679:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859685:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859701:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391552.859714:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790391552.859722:0:17217:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.859730:0:17217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391552.859735:0:17217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183086600/0x2b1b7949f13e214d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391552.859760:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:3638:x1877361186485632:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391552.859767:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790391552.859803:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186485632:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790391552.869536:0:17181:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1790391552.870337:0:17181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790391552.870340:0:17241:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1790391552.870344:0:17241:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1790391552.870912:0:17242:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790391552.871082:0:17181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1790391552.871341:0:17242:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1790391552.871629:0:17243:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9e5183b7df80 x1877361186485760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391552.871642:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00000040:01000000:3.0:1790391552.872110:0:17181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790391552.872145:0:17181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790391552.873099:0:17181:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790391552.873109:0:17181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790391552.873158:0:17181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391552.874959:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790391552.875432:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790391552.875486:0:17242:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1790391552.875703:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790391552.875741:0:17181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790391552.878255:0:17181:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1790391552.879296:0:17181:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1790391552.882078:0:17181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1790391552.884965:0:17181:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790391552.885007:0:17181:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab840199f988 00100000:10000000:3.0:1790391552.885018:0:17181:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790391552.885776:0:17181:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790391552.885805:0:17181:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790391552.885826:0:17181:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1790391552.885849:0:17181:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790391552.886797:0:17181:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391552.887048:0:17181:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790391553.555166:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790391553.864496:0:17237:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790391553.864509:0:17237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391553.870127:0:17237:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1790391553.870161:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790391553.927963:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 10000000:01000000:3.0:1790391554.119968:0:17199:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790391554.119977:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5284dc3000 from 7 10000000:01000000:3.0:1790391554.119983:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790391554.120043:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391554.120054:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391554.120065:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391554.120093:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186485888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391554.120180:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391554.120248:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186485888 00000100:00100000:1.0:1790391554.120258:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186485888 00000100:00100000:3.0:1790391554.120312:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391554.120328:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391554.120340:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+11:17199:x1877361186485888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391554.120367:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391554.120381:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5183087600/0x2b1b7949f13e215b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2154 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391554.120406:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183087600/0x2b1b7949f13e215b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2154 expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391554.120417:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5183087600/0x2b1b7949f13e215b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2154 expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391554.120426:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087600, rc 0) 00000100:00100000:1.0:1790391554.120474:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17199:x1877361186485888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391554.120481:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790391554.120535:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186485888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391554.120551:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391554.120560:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391554.120628:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186486016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790391554.120660:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391554.120685:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790391554.120762:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186486016 00000100:00100000:1.0:1790391554.120767:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186486016 00000100:00100000:1.0:1790391554.120800:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391554.120807:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a0b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17199:x1877361186486016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790391554.120821:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790391554.120841:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790391554.120844:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1790391554.121096:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a0b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17199:x1877361186486016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 289us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391554.121104:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790391554.123957:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186486016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790391554.124032:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391554.124042:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391554.124052:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391554.568026:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391554.888071:0:17237:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790391554.888081:0:17237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391554.888213:0:17237:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1790391554.888251:0:17237:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391554.888505:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:1.0:1790391554.951971:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:0.0:1790391555.592024:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391555.976939:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:3.0:1790391556.629571:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391557.002267:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00000001:02000400:2.0:1790391557.585238:0:17485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790391557.641659:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391558.024014:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00000100:00080000:2.0:1790391558.152923:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790391558.152931:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790391558.152935:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391558.152950:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:2.0:1790391558.152956:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790391558.152964:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e5284eef000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391558.153000:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5284945c00 x1877361186486272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391558.153800:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391558.153806:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391558.153808:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391558.153811:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391558.153813:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790391558.153816:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790391558.153819:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e5284ed9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391558.153826:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e5284ed9800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391558.153858:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5284947b80 x1877361186486400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391558.156248:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391558.156272:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186486144:0@lo:400:kworker.0 00000100:00100000:2.0:1790391558.156409:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391558.156591:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186486144 00000100:00100000:2.0:1790391558.156599:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186486144 00000100:00100000:2.0:1790391558.156647:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391558.156656:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:3640:x1877361186486144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391558.156711:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:3640:x1877361186486144:12345-0@lo:400:kworker.0 Request processed in 56us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391558.156735:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391558.156788:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186486144:0@lo:400:kworker.0 00000100:00100000:2.0:1790391558.156813:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186486272:0@lo:38:kworker.0 00000100:00100000:2.0:1790391558.157895:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391558.157931:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186486400:0@lo:38:kworker.0 00000100:00100000:2.0:1790391558.157982:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391558.163705:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186486272 00000100:00100000:1.0:1790391558.163720:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186486272 00000100:00100000:1.0:1790391558.163757:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391558.163766:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186486272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790391558.163787:0:17207:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790391558.170208:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186486400 00000100:00100000:2.0:1790391558.170257:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186486400 00000100:00100000:2.0:1790391558.170306:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790391558.170314:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186486400:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1790391558.170349:0:17203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1790391558.170381:0:17203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2b1b7949f13e2162 00000004:00100000:2.0:1790391558.170396:0:17203:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790391558.170529:0:17203:0:(import.c:65:import_set_state_nolock()) ffff9e52b9a8e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391558.170606:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1877361186486400:12345-0@lo:38:kworker.0 Request processed in 292us (12633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391558.170613:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790391558.170652:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5284947b80 x1877361186486400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391558.170668:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790391558.170674:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790391558.170679:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790391558.170681:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5284ed9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790391558.170686:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1877361186486400:0@lo:38:kworker.0 00000100:00100000:1.0:1790391558.185715:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186486272:12345-0@lo:38:kworker.0 Request processed in 21942us (27814us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790391558.185729:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1790391558.185784:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391558.185789:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790391558.185792:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186486272:0@lo:38:kworker.0 00000020:00000004:3.0:1790391558.507164:0:17538:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391558.514536:0:17538:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790391558.664338:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391559.049849:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00000020:00000004:0.0:1790391559.337404:0:17588:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391559.337613:0:17588:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790391559.688608:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391560.071947:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:3.0:1790391560.712468:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391561.097067:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:1.0:1790391561.745641:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391562.120209:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00000100:00100000:2.0:1790391562.248046:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391552/real 1790391552] req@ffff9e5284945500 x1877361186483328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391562 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391562.248106:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5284945500 x1877361186483328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391562 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391562.248119:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391552/real 1790391552] req@ffff9e5183a42680 x1877361186483200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391562 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391562.248130:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5183a42680 x1877361186483200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391562 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391562.248153:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391562.248183:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391562.248188:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186483328:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790391562.248195:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183375000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391562.248200:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391562.248203:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186483200:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790391562.248535:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790391562.248540:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790391562.248543:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391562.248548:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:3.0:1790391562.248554:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790391562.248561:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e5284eef000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391562.248582:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183a40a80 x1877361186486656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391562.248615:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391562.248618:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790391562.248620:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5183375000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391562.248623:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1790391562.248626:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790391562.248629:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5183375000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391562.248641:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183a43480 x1877361186486784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391562.248649:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391562.248652:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790391562.248653:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391562.248656:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1790391562.248658:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790391562.248661:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5183835000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391562.248670:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183a41f80 x1877361186486912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391562.248709:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391562.248724:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186486528:0@lo:400:kworker.0 00000100:00100000:3.0:1790391562.248796:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391562.248870:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186487040:0@lo:400:kworker.0 00000100:00100000:3.0:1790391562.248932:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391562.248979:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186486528 00000100:00100000:3.0:1790391562.248987:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186486528 00000100:00100000:3.0:1790391562.249036:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790391562.249059:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:3639:x1877361186486528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391562.249121:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:3639:x1877361186486528:12345-0@lo:400:kworker.0 Request processed in 67us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391562.249128:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790391562.249166:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186487040 00000100:00100000:3.0:1790391562.249170:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186487040 00000100:00100000:3.0:1790391562.249192:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790391562.249199:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186487040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391562.249234:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186487040:12345-0@lo:400:kworker.0 Request processed in 36us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391562.249240:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790391562.249273:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5183a41500 x1877361186487040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391562.249285:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186487040:0@lo:400:kworker.0 00000100:00100000:3.0:1790391562.249308:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186486528:0@lo:400:kworker.0 00000100:00100000:3.0:1790391562.249320:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186486656:0@lo:38:kworker.0 00000100:00100000:3.0:1790391562.249349:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391562.249368:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186486784:0@lo:8:kworker.0 00000400:00000100:3.0:1790391562.249387:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186486784 offset 0 length 520: 4 00000100:00100000:3.0:1790391562.249397:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186486912:0@lo:8:kworker.0 00000400:00000100:3.0:1790391562.249432:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186486912 offset 0 length 520: 4 00000100:00100000:0.0:1790391562.249737:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186486656 00000100:00100000:0.0:1790391562.249744:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186486656 00000100:00100000:0.0:1790391562.249772:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391562.249778:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186486656:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1790391562.249797:0:17206:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790391562.277478:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1877361186486656:12345-0@lo:38:kworker.0 Request processed in 27685us (28114us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790391562.277494:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1790391562.282543:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790391562.282557:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790391562.282562:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186486656:0@lo:38:kworker.0 00010000:00010000:3.0:1790391562.761264:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391563.148211:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:2.0:1790391563.787172:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790391564.104506:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790391564.168127:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:3.0:1790391564.824105:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391565.195791:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:2.0:1790391565.832007:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391566.223523:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:0.0:1790391566.857737:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790391567.009911:0:17933:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790391567.009915:0:17933:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1790391567.009917:0:17933:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790391567.010035:0:17933:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e5288361800 00000020:01000004:0.0:1790391567.010052:0:17933:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1790391567.010064:0:17933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790391567.010079:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9e52b9aacd40) 00000020:00000080:0.0:1790391567.010096:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790391567.089800:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1790391567.097408:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790391567.098136:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1790391567.098852:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790391567.099195:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1790391567.099413:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1790391567.099670:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1790391567.099920:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1790391567.100157:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790391567.100367:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1790391567.100610:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1790391567.100810:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1790391567.101147:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1790391567.101634:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1790391567.104572:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1790391567.105098:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1790391567.105387:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1790391567.105645:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1790391567.105899:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1790391567.106093:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1790391567.106289:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1790391567.106533:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790391567.106725:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790391567.107059:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790391567.107438:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1790391567.108154:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1790391567.108399:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1790391567.108715:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1790391567.109147:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1790391567.110067:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790391567.110291:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1790391567.111115:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1790391567.111386:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1790391567.111623:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1790391567.115609:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790391567.115815:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1790391567.116258:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1790391567.116536:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1790391567.116804:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790391567.117289:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1790391567.121501:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790391567.121860:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1790391567.122160:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790391567.122419:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790391567.122669:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790391567.122925:0:17933:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:2.0:1790391567.123811:0:17933:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790391567.124229:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1790391567.124243:0:17933:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790391567.124256:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e2170 00000020:01000004:2.0:1790391567.124264:0:17933:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1790391567.124286:0:17933:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790391567.124290:0:17933:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790391567.124296:0:17933:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1790391567.124323:0:17933:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1790391567.124328:0:17933:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1790391567.134870:0:17933:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790391567.135241:0:17933:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.128@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1790391567.135247:0:17933:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790391567.135249:0:17933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790391567.135250:0:17933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391567.135251:0:17933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391567.135252:0:17933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391567.135254:0:17933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391567.135255:0:17933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790391567.135256:0:17933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391567.135258:0:17933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790391567.135262:0:17933:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1790391567.135264:0:17933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790391567.135266:0:17933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790391567.135272:0:17933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391567.135273:0:17933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391567.135273:0:17933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391567.135274:0:17933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391567.135275:0:17933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790391567.135276:0:17933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391567.135277:0:17933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790391567.135311:0:17933:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790391567.135336:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487168:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790391567.135478:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.135535:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f22600 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.135602:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186487168 00000100:00100000:2.0:1790391567.135610:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186487168 00000100:00100000:2.0:1790391567.135715:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790391567.135724:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17933:x1877361186487168:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790391567.135751:0:17197:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790391567.135754:0:17197:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1790391567.135773:0:17197:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1790391567.136337:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17933:x1877361186487168:12345-0@lo:253:mount.lustre.0 Request processed in 611us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.136357:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391567.137557:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487168:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790391567.137574:0:17933:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1790391567.137577:0:17933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790391567.137579:0:17933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790391567.137580:0:17933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391567.137581:0:17933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391567.137582:0:17933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391567.137583:0:17933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391567.137584:0:17933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790391567.137586:0:17933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391567.137587:0:17933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790391567.137610:0:17933:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e5288361800 from lustre-MDT0001 10000000:01000000:3.0:1790391567.137639:0:17933:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1790391567.137642:0:17933:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790391567.137648:0:17933:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e52b5cacd40 local copy 00010000:00010000:3.0:1790391567.137659:0:17933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391567.137787:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391567.137836:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.137874:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5181f22900 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.138024:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186487296 00000100:00100000:2.0:1790391567.138030:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186487296 00000100:00100000:2.0:1790391567.138076:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790391567.138085:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17933:x1877361186487296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391567.138164:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17933:x1877361186487296:12345-0@lo:501:mount.lustre.0 Request processed in 79us (326us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790391567.138171:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391567.138248:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487296:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790391567.138261:0:17933:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790391567.138280:0:17933:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790391567.138286:0:17933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.138295:0:17933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391567.138323:0:17933:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e5288361800 10000000:01000000:0.0:1790391567.138327:0:17933:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790391567.138332:0:17933:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e52b5cacd40 10000000:01000000:0.0:1790391567.138335:0:17933:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790391567.138339:0:17933:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e52b5cacd40 from 1 10000000:01000000:0.0:1790391567.138341:0:17933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790391567.138377:0:17933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefc00/0x2b1b7949f13e2177 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.138386:0:17933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefc00/0x2b1b7949f13e2177 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.138395:0:17933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefc00/0x2b1b7949f13e2177 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391567.138409:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391567.138439:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391567.138468:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.138571:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186487424 00000100:00100000:2.0:1790391567.138575:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186487424 00000100:00100000:2.0:1790391567.138619:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391567.138625:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+12:17933:x1877361186487424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391567.138634:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391567.138649:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054a00/0x2b1b7949f13e217e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2177 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.138674:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054a00/0x2b1b7949f13e217e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2177 expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.138684:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054a00/0x2b1b7949f13e217e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2177 expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.138693:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054a00, rc 0) 00000100:00100000:2.0:1790391567.138724:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+13:17933:x1877361186487424:12345-0@lo:101:mount.lustre.0 Request processed in 99us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.138730:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391567.138760:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391567.138792:0:17933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefc00/0x2b1b7949f13e2177 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e217e expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.138801:0:17933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefc00/0x2b1b7949f13e2177 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e217e expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391567.138817:0:17933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790391567.138826:0:17933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefc00/0x2b1b7949f13e2177 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e217e expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.138833:0:17933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eefc00/0x2b1b7949f13e2177 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e217e expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391567.138846:0:17933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e5288361800 10000000:01000000:2.0:1790391567.138850:0:17933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790391567.138853:0:17933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e5288361800 from 1 10000000:01000000:2.0:1790391567.138855:0:17933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790391567.138870:0:17933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.138901:0:17933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.138909:0:17933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391567.138921:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391567.138945:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.138963:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186487552 00000100:00100000:2.0:1790391567.138966:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186487552 00000100:00100000:2.0:1790391567.139179:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790391567.139186:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+13:17933:x1877361186487552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391567.139193:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391567.139201:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054e00/0x2b1b7949f13e218c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2185 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.139214:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054e00/0x2b1b7949f13e218c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2185 expref: 14 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.139222:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054e00/0x2b1b7949f13e218c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2185 expref: 14 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.139239:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054e00, rc 0) 00000100:00100000:2.0:1790391567.139259:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+14:17933:x1877361186487552:12345-0@lo:101:mount.lustre.0 Request processed in 75us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.139265:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790391567.139293:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52852c9900 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.139305:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391567.139315:0:17933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.139323:0:17933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391567.139334:0:17933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790391567.139338:0:17933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.140473:0:17933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184054800/0x2b1b7949f13e2185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e218c expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391567.140488:0:17933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1790391567.140496:0:17933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790391567.140502:0:17933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e5288361800 10000000:01000000:2.0:1790391567.140504:0:17933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790391567.140508:0:17933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1790391567.140510:0:17933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790391567.140539:0:17933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.140562:0:17933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.140572:0:17933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391567.140593:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391567.140642:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.140673:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52852c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.140744:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186487680 00000100:00100000:0.0:1790391567.140750:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186487680 00000100:00100000:0.0:1790391567.140812:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790391567.140820:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+14:17933:x1877361186487680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391567.140828:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391567.140839:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e219a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2193 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.140856:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e219a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2193 expref: 15 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.140866:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eef400/0x2b1b7949f13e219a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2193 expref: 15 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.140874:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef400, rc 0) 00000100:00100000:0.0:1790391567.140938:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+15:17933:x1877361186487680:12345-0@lo:101:mount.lustre.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.140944:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790391567.141103:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391567.141117:0:17933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.141126:0:17933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391567.145151:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1790391567.146407:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391567.156925:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790391567.157029:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1790391567.157047:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1790391567.157059:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1790391567.157072:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1790391567.157085:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1790391567.157098:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1790391567.157111:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1790391567.157124:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1790391567.157136:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1790391567.157161:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1790391567.157174:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1790391567.157186:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1790391567.157198:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1790391567.157210:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1790391567.157223:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1790391567.157235:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1790391567.157248:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1790391567.157259:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1790391567.157275:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1790391567.157288:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1790391567.157301:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1790391567.157313:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1790391567.157341:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1790391567.157347:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1790391567.157486:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391567.157554:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391567.157596:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52aff22e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.157870:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186487808 00000100:00100000:0.0:1790391567.157910:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186487808 00000100:00100000:0.0:1790391567.157968:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790391567.157980:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+15:17933:x1877361186487808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391567.158130:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+15:17933:x1877361186487808:12345-0@lo:501:mount.lustre.0 Request processed in 152us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.158137:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790391567.158587:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391567.158631:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391567.158679:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391567.158789:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52aff22e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.164517:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186487936 00000100:00100000:2.0:1790391567.164538:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186487936 00000100:00100000:2.0:1790391567.164598:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790391567.164608:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+15:17933:x1877361186487936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391567.165430:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+15:17933:x1877361186487936:12345-0@lo:503:mount.lustre.0 Request processed in 819us (6745us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.165440:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790391567.165539:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186487936:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790391567.166046:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391567.166126:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186488064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391567.166179:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391567.166217:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52aff22e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391567.166434:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186488064 00000100:00100000:3.0:1790391567.166441:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186488064 00000100:00100000:3.0:1790391567.166487:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391567.166496:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+15:17933:x1877361186488064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391567.167250:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+15:17933:x1877361186488064:12345-0@lo:502:mount.lustre.0 Request processed in 753us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391567.167258:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391567.167540:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186488064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790391567.167838:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790391567.167866:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1790391567.167907:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1790391567.167924:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1790391567.167938:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1790391567.167952:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1790391567.167965:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1790391567.167977:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1790391567.167991:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1790391567.168006:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1790391567.168021:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1790391567.168036:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1790391567.168050:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1790391567.168063:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1790391567.168076:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1790391567.168087:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1790391567.168099:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1790391567.168111:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1790391567.168124:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1790391567.168135:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1790391567.168147:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1790391567.168160:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1790391567.168173:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1790391567.168189:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1790391567.168201:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1790391567.168214:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1790391567.168226:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1790391567.168239:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1790391567.168251:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1790391567.168262:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1790391567.168275:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1790391567.168288:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1790391567.168309:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1790391567.168321:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1790391567.168333:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1790391567.168345:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1790391567.168359:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1790391567.168371:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1790391567.168384:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1790391567.168404:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1790391567.168758:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1790391567.168787:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1790391567.168801:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1790391567.168813:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1790391567.168850:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186488192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391567.168939:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391567.168968:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52aff22e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.169004:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186488192 00000100:00100000:0.0:1790391567.169010:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186488192 00000100:00100000:0.0:1790391567.169055:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790391567.169070:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+15:17933:x1877361186488192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391567.169174:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+15:17933:x1877361186488192:12345-0@lo:502:mount.lustre.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.169183:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790391567.169203:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186488192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790391567.169242:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1790391567.169249:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1790391567.170960:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391567.170975:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.170978:0:17937:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1790391567.170985:0:17937:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1790391567.170988:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391567.171004:0:17937:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9e52b5ca99c0) 00000020:00000080:1.0:1790391567.171027:0:17937:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1790391567.171033:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790391567.171105:0:17937:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790391567.171112:0:17937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e21a8 00000020:00000080:1.0:1790391567.171318:0:17937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1790391567.171322:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391567.171326:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.171337:0:17937:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1790391567.171341:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391567.171444:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.171447:0:17937:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1790391567.171452:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391567.171469:0:17937:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9e52ba40cd40) 00000020:00000080:1.0:1790391567.171481:0:17937:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1790391567.171486:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790391567.171488:0:17937:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1790391567.171491:0:17937:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1790391567.171497:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790391567.171556:0:17937:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5288361800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1790391567.171568:0:17937:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9e52ba4099c0) 00000020:00000080:1.0:1790391567.171577:0:17937:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1790391567.171630:0:17937:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790391567.171637:0:17937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e21bd 00000020:00000080:1.0:1790391567.171730:0:17937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1790391567.171737:0:17937:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790391567.171742:0:17937:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2b1b7949f13e21c4 00080000:01000000:1.0:1790391567.171748:0:17937:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790391567.171751:0:17937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e21cb 00000100:00100000:2.0:1790391567.239984:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:3.0:1790391567.268265:0:17937:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1790391567.269043:0:17937:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1790391567.269316:0:17937:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790391567.270293:0:17937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1790391567.270305:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790391567.270311:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391567.270314:0:17937:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1790391567.270317:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790391567.270323:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790391567.270325:0:17937:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1790391567.270328:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790391567.270334:0:17937:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:00000080:3.0:1790391567.270372:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790391567.270385:0:17937:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9e52b5ef99c0) 00000020:00000080:3.0:1790391567.270406:0:17937:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1790391567.270411:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790391567.270482:0:17937:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1790391567.270489:0:17937:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790391567.270496:0:17937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e21d9 00010000:00080000:3.0:1790391567.270525:0:17937:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e528765d000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391567.272195:0:17937:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1790391567.280162:0:17937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790391567.280181:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790391567.280247:0:17937:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790391567.280273:0:17937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e21e0 00000100:00080000:0.0:1790391567.280286:0:17937:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391567.280292:0:17937:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e528765d000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391567.280334:0:17937:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf94a300 x1877361186488320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391567.280483:0:17937:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1790391567.280548:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391567.280553:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391567.280555:0:17937:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1790391567.280558:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790391567.280561:0:17937:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1790391567.280563:0:17937:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790391567.280564:0:17937:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790391567.280566:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790391567.280568:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391567.280569:0:17937:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790391567.280572:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391567.280577:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391567.280578:0:17937:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1790391567.280582:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790391567.280614:0:17937:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790391567.280627:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391567.280630:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391567.280637:0:17937:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1790391567.280640:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790391567.280642:0:17937:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1790391567.280644:0:17937:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790391567.280645:0:17937:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790391567.280647:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790391567.280650:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391567.280651:0:17937:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790391567.280654:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790391567.280657:0:17937:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790391567.280660:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391567.280662:0:17937:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790391567.280665:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790391567.280669:0:17937:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:0.0:1790391567.280697:0:17937:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790391567.280700:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391567.280715:0:17937:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e52b9aa99c0) 00000020:00000080:0.0:1790391567.280728:0:17937:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1790391567.280733:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790391567.280817:0:17937:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790391567.280825:0:17937:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790391567.280831:0:17937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e21ee 00010000:00080000:0.0:1790391567.280863:0:17937:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e528765e000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:0.0:1790391567.281099:0:17937:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1790391567.281547:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790391567.281553:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790391567.281556:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790391567.281561:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:1.0:1790391567.281566:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790391567.281572:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e5284eef000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391567.281599:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183b7ed80 x1877361186488448/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391567.281613:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391567.281623:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391567.281626:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391567.281629:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790391567.282022:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186488576:0@lo:400:kworker.0 00000100:00100000:1.0:1790391567.282112:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1790391567.282284:0:17937:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790391567.282498:0:17937:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1790391567.283859:0:17937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391567.284212:0:17937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1790391567.284327:0:17937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:3.0:1790391567.284703:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186488320:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790391567.284803:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.284846:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186488448:0@lo:38:kworker.0 00000100:00100000:3.0:1790391567.284908:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.284953:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186488576 00000100:00100000:3.0:1790391567.284963:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186488576 00000100:00100000:3.0:1790391567.285016:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391567.285025:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186488576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391567.285099:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186488576:12345-0@lo:400:kworker.0 Request processed in 74us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391567.285107:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391567.285131:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186488320 00000100:00100000:3.0:1790391567.285134:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186488320 00000100:00100000:3.0:1790391567.285145:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186488448 00000100:00100000:3.0:1790391567.285147:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186488448 00000100:00100000:3.0:1790391567.285156:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391567.285160:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186488320:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790391567.285182:0:17207:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1790391567.285224:0:17207:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e21f5 00000004:00100000:3.0:1790391567.285240:0:17207:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790391567.285247:0:17207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:3.0:1790391567.285335:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5183b7e680 x1877361186488576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391567.285639:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186488576:0@lo:400:kworker.0 00000040:00080000:2.0:1790391567.285824:0:17942:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790391567.285829:0:17942:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790391567.286609:0:17937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790391567.286621:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790391567.286658:0:17937:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790391567.286677:0:17937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e21fc 00000100:00080000:0.0:1790391567.286691:0:17937:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391567.286697:0:17937:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e528765e000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391567.286731:0:17937:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf949500 x1877361186488704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391567.286807:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186488704:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790391567.286854:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186488704 offset 0 length 520: 4 00000100:00080000:0.0:1790391567.286979:0:17937:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790391567.287048:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391567.287053:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391567.287054:0:17937:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790391567.287057:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790391567.287060:0:17937:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1790391567.287061:0:17937:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790391567.287062:0:17937:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790391567.287064:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790391567.287066:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391567.287067:0:17937:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790391567.287070:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790391567.287074:0:17937:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790391567.287078:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391567.287079:0:17937:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790391567.287081:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790391567.287085:0:17937:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.128@tcp to nid 0x20000c0a8ca80 (192.168.202.128@tcp) 00000020:01000000:0.0:1790391567.287107:0:17937:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790391567.287110:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790391567.287122:0:17937:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e52b9aa8000) 00000020:00000080:0.0:1790391567.287137:0:17937:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1790391567.287142:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790391567.287209:0:17937:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1790391567.287217:0:17937:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790391567.287224:0:17937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2b1b7949f13e220a 00010000:00080000:0.0:1790391567.287247:0:17937:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e51838d2800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:0.0:1790391567.287452:0:17937:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1790391567.287530:0:17937:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790391567.287545:0:17937:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1790391567.289070:0:17937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1790391567.289312:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391567.289319:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790391567.289322:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790391567.289326:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1790391567.289484:0:17937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1790391567.289604:0:17937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1790391567.290132:0:17944:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790391567.290137:0:17944:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00080000:0.0:1790391567.291593:0:17207:0:(import.c:65:import_set_state_nolock()) ffff9e51838d0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391567.291702:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1877361186488320:12345-0@lo:38:llog_process_th.0 Request processed in 6537us (6897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.291714:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391567.291743:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391567.291749:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186488448:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1790391567.291800:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186488448:12345-0@lo:38:kworker.0 Request processed in 50us (6892us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790391567.291807:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790391567.291910:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391567.291920:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1790391567.291929:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1790391567.291935:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790391567.291938:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528765d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790391567.291953:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186488320:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391567.291965:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391567.291969:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391567.291974:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790391567.291977:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186488448:0@lo:38:kworker.0 00000100:00100000:1.0:1790391567.292122:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391567.292136:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186488832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391567.292174:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391567.292248:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186488832 00000100:00100000:0.0:1790391567.292254:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186488832 00000100:00100000:0.0:1790391567.292294:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391567.292301:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1877361186488832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790391567.292324:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790391567.292448:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1877361186488832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.292455:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391567.292518:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186488832:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1790391567.293824:0:17937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790391567.293848:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790391567.294213:0:17937:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790391567.294241:0:17937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e2211 00000100:00080000:2.0:1790391567.294250:0:17937:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391567.294258:0:17937:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e51838d2800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391567.294297:0:17937:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5284945500 x1877361186488960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391567.294373:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186488960:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790391567.294423:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186488960 offset 0 length 520: 4 00000100:00080000:2.0:1790391567.294528:0:17937:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790391567.294597:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391567.294602:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391567.294604:0:17937:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790391567.294607:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391567.294611:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391567.294613:0:17937:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790391567.294616:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391567.294617:0:17937:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790391567.294619:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391567.294622:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391567.294623:0:17937:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790391567.294626:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391567.294627:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391567.294629:0:17937:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790391567.294632:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790391567.294669:0:17937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391567.294672:0:17937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391567.294674:0:17937:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790391567.294678:0:17937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1790391567.294738:0:17933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1790391567.294808:0:17933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790391567.294824:0:17933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.294847:0:17933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184054400/0x2b1b7949f13e2193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e219a expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391567.294854:0:17933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5288361800 from 1 10000000:01000000:2.0:1790391567.294857:0:17933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391567.294912:0:17933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.294921:0:17933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.294931:0:17933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391567.294947:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391567.294989:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.295010:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b994e3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1790391567.295239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391567.295244:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790391567.295253:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391567.295256:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790391567.295283:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186489088 00000100:00100000:3.0:1790391567.295290:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186489088 00000100:00100000:3.0:1790391567.295349:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790391567.295359:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+15:17933:x1877361186489088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391567.295372:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391567.295387:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e221f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2218 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.295410:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e221f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2218 expref: 16 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.295422:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e221f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2218 expref: 16 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.295431:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d600, rc 0) 00000100:00100000:3.0:1790391567.295470:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+16:17933:x1877361186489088:12345-0@lo:101:mount.lustre.0 Request processed in 112us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391567.295477:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790391567.295871:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391567.295925:0:17933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.295937:0:17933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391567.296592:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489216:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790391567.296644:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.296720:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b994e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.302270:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186489216 00000100:00100000:0.0:1790391567.302288:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186489216 00000100:00100000:0.0:1790391567.302369:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790391567.302379:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+16:17933:x1877361186489216:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790391567.302422:0:17197:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790391567.302442:0:17197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790391567.302445:0:17197:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1790391567.302845:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+16:17933:x1877361186489216:12345-0@lo:256:mount.lustre.0 Request processed in 467us (6199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.302854:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790391567.305508:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489216:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790391567.306120:0:17933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790391567.306146:0:17933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.306160:0:17933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391567.306170:0:17933:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5288361800 from 1 10000000:01000000:2.0:1790391567.306174:0:17933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391567.306217:0:17933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.306226:0:17933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.306236:0:17933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391567.306256:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391567.306314:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.306604:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b994e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.306669:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186489344 00000100:00100000:0.0:1790391567.306677:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186489344 00000100:00100000:0.0:1790391567.306732:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790391567.306742:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+16:17933:x1877361186489344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391567.306754:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391567.306777:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eef000/0x2b1b7949f13e222d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2226 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.306800:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eef000/0x2b1b7949f13e222d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2226 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.306810:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eef000/0x2b1b7949f13e222d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2226 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.306818:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef000, rc 0) 00000100:00100000:0.0:1790391567.306864:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17933:x1877361186489344:12345-0@lo:101:mount.lustre.0 Request processed in 123us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.306870:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790391567.307034:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391567.307048:0:17933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.307058:0:17933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391567.307207:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391567.307241:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391567.307267:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.307285:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b994ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.307481:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186489472 00000100:00100000:0.0:1790391567.307486:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186489472 00000100:00100000:0.0:1790391567.307516:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790391567.307523:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17933:x1877361186489472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391567.307617:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17933:x1877361186489472:12345-0@lo:501:mount.lustre.0 Request processed in 94us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.307623:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790391567.307697:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391567.307727:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391567.307783:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.307807:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.307860:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186489600 00000100:00100000:0.0:1790391567.307864:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186489600 00000100:00100000:0.0:1790391567.307920:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790391567.307928:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17933:x1877361186489600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391567.308144:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17933:x1877361186489600:12345-0@lo:503:mount.lustre.0 Request processed in 217us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.308152:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790391567.308330:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790391567.308684:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391567.308772:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391567.308811:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.308844:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391567.309006:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186489728 00000100:00100000:1.0:1790391567.309012:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186489728 00000100:00100000:1.0:1790391567.309046:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790391567.309054:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17933:x1877361186489728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391567.309138:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17933:x1877361186489728:12345-0@lo:502:mount.lustre.0 Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391567.309145:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790391567.309317:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790391567.309609:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790391567.309637:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1790391567.309650:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1790391567.309673:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1790391567.309688:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1790391567.309702:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1790391567.309719:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1790391567.309731:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1790391567.309743:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790391567.309756:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1790391567.309782:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1790391567.309808:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391567.309843:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.310034:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.313115:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186489856 00000100:00100000:2.0:1790391567.313131:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186489856 00000100:00100000:2.0:1790391567.313247:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391567.313259:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17933:x1877361186489856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391567.313459:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17933:x1877361186489856:12345-0@lo:502:mount.lustre.0 Request processed in 202us (3613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.313467:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790391567.313558:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790391567.313642:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1790391567.313657:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790391567.317411:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391567.317428:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.317430:0:17946:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790391567.317438:0:17946:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5288361800 00000020:00000080:1.0:1790391567.317441:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790391567.317450:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391567.317453:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.317454:0:17946:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790391567.317456:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391567.317458:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.317460:0:17946:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790391567.317462:0:17946:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e5288361800 00000020:00000080:1.0:1790391567.317465:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790391567.317581:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391567.317586:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.317587:0:17946:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790391567.317590:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391567.317592:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.317593:0:17946:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790391567.317597:0:17946:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5288361800 00000020:00000080:1.0:1790391567.317606:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790391567.329089:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391567.329103:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.329105:0:17946:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790391567.329109:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790391567.329113:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.329114:0:17946:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790391567.329119:0:17946:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e5288361800 00000020:00000080:1.0:1790391567.329121:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790391567.329188:0:17946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790391567.329192:0:17946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391567.329194:0:17946:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790391567.329197:0:17946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1790391567.329873:0:17933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790391567.329937:0:17933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391567.329959:0:17933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.329973:0:17933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391567.330049:0:17933:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790391567.330052:0:17933:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e5288361800 10000000:01000000:3.0:1790391567.330055:0:17933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e5288361800 10000000:01000000:3.0:1790391567.330059:0:17933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391567.330065:0:17933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e5288361800 from 1 10000000:01000000:3.0:1790391567.330068:0:17933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391567.330102:0:17933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.330112:0:17933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.330124:0:17933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391567.330148:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391567.330214:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.330249:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776c480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.336795:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186489984 00000100:00100000:0.0:1790391567.336812:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186489984 00000100:00100000:0.0:1790391567.336863:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790391567.336873:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17933:x1877361186489984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391567.336915:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391567.336933:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eeee00/0x2b1b7949f13e223b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2234 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.336960:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eeee00/0x2b1b7949f13e223b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2234 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.336971:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eeee00/0x2b1b7949f13e223b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2234 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.339432:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eeee00, rc 0) 00000100:00100000:0.0:1790391567.339518:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186489984:12345-0@lo:101:mount.lustre.0 Request processed in 2643us (9301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.339536:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391567.341507:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186489984:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391567.341536:0:17933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.341549:0:17933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391567.342640:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790391567.345513:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391567.345813:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1790391567.345841:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1790391567.345856:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1790391567.345869:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1790391567.345903:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1790391567.345917:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1790391567.345927:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1790391567.345952:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1790391567.345965:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1790391567.345976:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1790391567.345987:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1790391567.345998:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1790391567.346021:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1790391567.346036:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1790391567.346048:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1790391567.346061:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1790391567.346072:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1790391567.346086:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1790391567.346098:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1790391567.346112:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1790391567.346126:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1790391567.346140:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1790391567.346153:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1790391567.346166:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1790391567.346179:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1790391567.346192:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1790391567.346205:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1790391567.346218:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1790391567.346252:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1790391567.346259:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790391567.349488:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391567.349571:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.349615:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52aff22e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.349650:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186490112 00000100:00100000:2.0:1790391567.349657:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186490112 00000100:00100000:2.0:1790391567.349710:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391567.349720:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391567.349860:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490112:12345-0@lo:501:mount.lustre.0 Request processed in 140us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.349874:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790391567.349939:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391567.349977:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391567.350014:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.350031:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.350043:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186490240 00000100:00100000:2.0:1790391567.350046:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186490240 00000100:00100000:2.0:1790391567.350070:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790391567.350075:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391567.350150:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490240:12345-0@lo:503:mount.lustre.0 Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.350156:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790391567.350194:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790391567.354863:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391567.354984:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391567.355065:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.355103:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.355125:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186490368 00000100:00100000:2.0:1790391567.355131:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186490368 00000100:00100000:2.0:1790391567.355175:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790391567.355184:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391567.355289:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490368:12345-0@lo:502:mount.lustre.0 Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.355298:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790391567.355369:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391567.355541:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1790391567.355566:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1790391567.355579:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1790391567.355593:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1790391567.355606:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1790391567.355619:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1790391567.355632:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1790391567.355645:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1790391567.355659:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1790391567.355671:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1790391567.355684:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1790391567.355697:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1790391567.355711:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1790391567.355738:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1790391567.355754:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1790391567.355779:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1790391567.355795:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1790391567.355809:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1790391567.355823:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1790391567.355835:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1790391567.355846:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1790391567.355859:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1790391567.355869:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1790391567.355920:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1790391567.355935:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1790391567.355946:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1790391567.355959:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1790391567.355973:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1790391567.355987:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1790391567.356015:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1790391567.356030:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1790391567.356053:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1790391567.356066:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1790391567.356080:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1790391567.356093:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1790391567.356106:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1790391567.356119:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1790391567.356132:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1790391567.356144:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1790391567.356159:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1790391567.356173:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1790391567.356185:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1790391567.356199:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1790391567.356213:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1790391567.356227:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1790391567.356254:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1790391567.356270:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1790391567.356285:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1790391567.356326:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391567.356375:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.356409:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.356434:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186490496 00000100:00100000:2.0:1790391567.356440:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186490496 00000100:00100000:2.0:1790391567.356474:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391567.356482:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391567.356561:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490496:12345-0@lo:502:mount.lustre.0 Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.356569:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391567.356614:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391567.356754:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1790391567.356794:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1790391567.356813:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391567.356845:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.356859:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391567.356873:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186490624 00000100:00100000:2.0:1790391567.356905:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186490624 00000100:00100000:2.0:1790391567.356928:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391567.356934:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391567.356993:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490624:12345-0@lo:502:mount.lustre.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.356999:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391567.357034:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391567.357064:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1790391567.357072:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790391567.366376:0:17951:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1790391567.366395:0:17951:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9e52b5efcd40) 00000020:00000080:3.0:1790391567.366420:0:17951:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1790391567.366519:0:17951:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e5288361800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790391567.366523:0:17951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e5288361800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790391567.366526:0:17951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e5288361800 3 00010000:00080000:3.0:1790391567.366558:0:17951:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e529518d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.128@tcp at head 00010000:00010000:3.0:1790391567.368178:0:17951:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1790391567.368373:0:17951:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1790391567.368416:0:17951:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790391567.368434:0:17951:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2b1b7949f13e2249 00000100:00080000:3.0:1790391567.368444:0:17951:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790391567.368450:0:17951:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e529518d000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391567.368503:0:17951:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183a40700 x1877361186490752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391567.368539:0:17951:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790391567.368838:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391567.368843:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391567.368846:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391567.368849:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790391567.370814:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186490752:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790391567.370920:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.371076:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186490752 00000100:00100000:2.0:1790391567.371084:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186490752 00000100:00100000:2.0:1790391567.371112:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391567.371118:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1877361186490752:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790391567.371141:0:17203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:2.0:1790391567.371170:0:17203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2b1b7949f13e2250 00000004:00100000:2.0:1790391567.371182:0:17203:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790391567.371215:0:17203:0:(import.c:65:import_set_state_nolock()) ffff9e52a75c2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391567.371257:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1877361186490752:12345-0@lo:38:llog_process_th.0 Request processed in 138us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391567.371262:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790391567.371295:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5183a40700 x1877361186490752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391567.371302:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790391567.371309:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1790391567.371314:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790391567.371317:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790391567.371318:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e529518d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790391567.371322:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1877361186490752:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790391567.379547:0:17951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1790391567.379610:0:17933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790391567.379641:0:17933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790391567.379663:0:17933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.379675:0:17933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b763d800/0x2b1b7949f13e2234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e223b expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790391567.379723:0:17933:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790391567.379726:0:17933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790391567.379727:0:17933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391567.379728:0:17933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391567.379729:0:17933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391567.379730:0:17933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391567.379731:0:17933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790391567.379733:0:17933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391567.379734:0:17933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391567.379738:0:17933:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1790391567.379745:0:17933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391567.379746:0:17933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790391567.379747:0:17933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391567.379748:0:17933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391567.379749:0:17933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391567.379750:0:17933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391567.379751:0:17933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790391567.379752:0:17933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391567.379753:0:17933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391567.379790:0:17933:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790391567.379812:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490880:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790391567.379913:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.379950:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.387236:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186490880 00000100:00100000:0.0:1790391567.387252:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186490880 00000100:00100000:0.0:1790391567.387321:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790391567.387543:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790391567.387581:0:17196:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790391567.387597:0:17196:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1790391567.391803:0:17182:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1790391567.391915:0:17196:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790391567.391928:0:17196:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1790391567.391941:0:17217:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790391567.391946:0:17217:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790391567.391970:0:17217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.391991:0:17217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5183087600/0x2b1b7949f13e215b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2154 expref: 18 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.392000:0:17217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e221f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2218 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.392008:0:17217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.392050:0:17217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e221f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2218 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.392064:0:17217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e221f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2218 expref: 18 pid: 17196 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391567.392079:0:17217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186491008:0@lo:104: 00000100:00100000:3.0:1790391567.392265:0:17217:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790391567.392317:0:17217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5183087600/0x2b1b7949f13e215b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2154 expref: 18 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391567.392330:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186491008 00010000:00010000:3.0:1790391567.392335:0:17217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5183087600/0x2b1b7949f13e215b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2154 expref: 18 pid: 17197 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391567.392336:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186491008 00000100:00100000:0.0:1790391567.392382:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391567.392392:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:17217:x1877361186491008:12345-0@lo:104: 00010000:00010000:0.0:1790391567.392405:0:17185:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391567.392464:0:17185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790391567.392470:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:17217:x1877361186491008:12345-0@lo:104: Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.392477:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391567.392653:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17933:x1877361186490880:12345-0@lo:253:mount.lustre.0 Request processed in 5322us (12739us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391567.392662:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790391567.392716:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17933:1877361186490880:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790391567.392728:0:17933:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790391567.392731:0:17933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790391567.392733:0:17933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790391567.392734:0:17933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391567.392735:0:17933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391567.392737:0:17933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391567.392738:0:17933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391567.392739:0:17933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790391567.392741:0:17933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391567.392743:0:17933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790391567.392757:0:17933:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1790391567.393017:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391567.393025:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.393034:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055c00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391567.393038:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.393048:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391567.393055:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391567.393062:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391567.393091:0:17190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.393098:0:17190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391567.393118:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.393134:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5184055c00/0x2b1b7949f13e2218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e221f expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391567.393147:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391567.393149:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391567.393151:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391567.395691:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186491264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391567.395937:0:17217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186491136:0@lo:104: 00000100:00100000:3.0:1790391567.395978:0:17217:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.396024:0:17217:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391567.396050:0:17217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186491008:0@lo:104: 00000100:00100000:3.0:1790391567.396073:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186491136 00000100:00100000:3.0:1790391567.396078:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186491136 00000100:00100000:3.0:1790391567.396120:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391567.396127:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:17217:x1877361186491136:12345-0@lo:104: 00010000:00010000:3.0:1790391567.396143:0:17185:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.396189:0:17185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790391567.396195:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:17217:x1877361186491136:12345-0@lo:104: Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391567.396201:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790391567.396223:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391567.396229:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.396237:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763cc00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391567.396241:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.396249:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391567.396263:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391567.396269:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790391567.396303:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.396310:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391567.396336:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.396344:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e2154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e215b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.396359:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391567.396361:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391567.396362:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391567.396374:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391567.396383:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186491392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391567.396410:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.396450:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186491392 00000100:00100000:3.0:1790391567.396454:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186491392 00010000:00010000:3.0:1790391567.396469:0:17188:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5183087600/0x2b1b7949f13e215b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2154 expref: 18 pid: 17197 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391567.396504:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391567.396509:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:3638:x1877361186491392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391567.396519:0:17188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391567.396530:0:17188:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5183087600/0x2b1b7949f13e215b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2154 expref: 18 pid: 17197 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.396539:0:17188:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5183087600/0x2b1b7949f13e215b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2154 expref: 18 pid: 17197 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.396556:0:17188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391567.396582:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:3638:x1877361186491392:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391567.396588:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790391567.396614:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186491392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391567.396636:0:17217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183087600/0x2b1b7949f13e215b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2154 expref: 17 pid: 17197 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391567.396646:0:17217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186491136:0@lo:104: 00010000:00010000:3.0:1790391567.396659:0:17217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391567.406652:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391567.408959:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186491264 00000100:00100000:3.0:1790391567.408978:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186491264 00010000:00010000:3.0:1790391567.409026:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e221f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2218 expref: 17 pid: 17196 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391567.409065:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391567.409074:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:3640:x1877361186491264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391567.409089:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391567.409094:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e221f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2218 expref: 17 pid: 17196 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.409120:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e221f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2218 expref: 17 pid: 17196 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.409139:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e221f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2218 expref: 17 pid: 17196 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.409155:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.409164:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790391567.409181:0:17189:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017236982s 00010000:00010000:3.0:1790391567.409186:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.409194:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.409201:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.409207:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.409213:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763ce00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391567.409217:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.409225:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391567.418653:0:17217:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391567.418694:0:17217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.419699:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.419717:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b763ce00/0x2b1b7949f13e2257 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391567.419743:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391567.419847:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+16:3640:x1877361186491264:12345-0@lo:103:ldlm_bl.0 Request processed in 10771us (13201us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391567.419859:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790391567.420652:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186491264:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1790391567.422177:0:17933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1790391567.422178:0:17957:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1790391567.422183:0:17957:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790391567.422509:0:17958:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790391567.422555:0:17933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1790391567.423155:0:17958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391567.426648:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790391567.426953:0:17958:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1790391567.427369:0:17959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1877361186491520:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1790391567.427455:0:17933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1790391567.427489:0:17959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790391567.427491:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790391567.427525:0:17959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.427575:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186491520 00000100:00100000:0.0:1790391567.427583:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186491520 00000100:00100000:0.0:1790391567.427652:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391567.427661:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17959:x1877361186491520:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790391567.427747:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17959:x1877361186491520:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 87us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.427754:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391567.427830:0:17959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1877361186491520:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1790391567.427861:0:17959:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1790391567.427924:0:17959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1877361186491648:0@lo:1000:lod0001_rec0000.0 00000004:00000080:3.0:1790391567.427934:0:17933:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790391567.427940:0:17933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1790391567.427954:0:17959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790391567.427979:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391567.428136:0:17959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391567.428159:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186491648 00000100:00100000:1.0:1790391567.428163:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186491648 00000100:00100000:1.0:1790391567.428183:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391567.428189:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17959:x1877361186491648:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790391567.428347:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17959:x1877361186491648:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 158us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391567.428354:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391567.428473:0:17959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1877361186491648:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790391567.428520:0:17959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17959:1877361186491776:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790391567.428544:0:17959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391567.428591:0:17959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d4180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391567.428624:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186491776 00000100:00100000:0.0:1790391567.428628:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186491776 00000100:00100000:0.0:1790391567.428676:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391567.428683:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17959:x1877361186491776:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790391567.428794:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17959:x1877361186491776:12345-0@lo:900:lod0001_rec0000.0 Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391567.428801:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790391567.428847:0:17959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e5284947100 x1877361186491776/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790391583 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391567.428859:0:17959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17959:1877361186491776:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790391567.428921:0:17959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1877361186491904:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790391567.428945:0:17959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391567.428964:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186491904 00000100:00100000:1.0:1790391567.428967:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186491904 00000040:00080000:3.0:1790391567.428979:0:17933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1790391567.428998:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391567.429004:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17959:x1877361186491904:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790391567.429053:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17959:x1877361186491904:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391567.429059:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391567.429074:0:17959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b46900 going to sleep for 11 seconds 00000100:00100000:1.0:1790391567.429084:0:17959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1877361186491904:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1790391567.429116:0:17959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391567.429630:0:17933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790391567.429657:0:17933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1790391567.429755:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790391567.430264:0:17933:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1790391567.431988:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790391567.432060:0:17959:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790391567.432064:0:17959:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1790391567.432807:0:17933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1790391567.437365:0:17933:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790391567.437676:0:17933:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffab8405553988 00100000:10000000:3.0:1790391567.437686:0:17933:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1790391567.438110:0:17933:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790391567.438139:0:17933:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790391567.438157:0:17933:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1790391567.438183:0:17933:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1790391567.438914:0:17933:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391567.439256:0:17933:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790391567.880008:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391568.264476:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00000040:00080000:2.0:1790391568.461768:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790391568.904154:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790391568.972087:0:17199:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790391568.972097:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5288361800 from 8 10000000:01000000:1.0:1790391568.972104:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790391568.972155:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391568.972168:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391568.972180:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391568.972208:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186492032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790391568.972353:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391568.972407:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5290b466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391568.972576:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186492032 00000100:00100000:0.0:1790391568.972585:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186492032 00000100:00100000:0.0:1790391568.972637:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790391568.972646:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+16:17199:x1877361186492032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391568.972659:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391568.972674:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eee400/0x2b1b7949f13e2265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e225e expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.972714:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eee400/0x2b1b7949f13e2265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e225e expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.972724:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eee400/0x2b1b7949f13e2265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e225e expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.972734:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eee400, rc 0) 00000100:00100000:0.0:1790391568.972790:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17199:x1877361186492032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391568.972797:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790391568.972843:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186492032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391568.972856:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.972865:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391568.972939:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186492160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790391568.972968:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391568.972989:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93b840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391568.973000:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186492160 00000100:00100000:0.0:1790391568.973004:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186492160 00000100:00100000:0.0:1790391568.973024:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790391568.973030:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17199:x1877361186492160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790391568.973042:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790391568.973059:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790391568.973066:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1790391568.973137:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17199:x1877361186492160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391568.973144:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790391568.973173:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186492160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790391568.973210:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790391568.973217:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.973225:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391568.973234:0:17199:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790391568.973236:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5284dc3000 from 8 10000000:01000000:0.0:1790391568.973238:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790391568.974352:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.974367:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.974378:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391568.974396:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186492288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391568.974441:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391568.974474:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93b840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391568.974560:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186492288 00000100:00100000:0.0:1790391568.974567:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186492288 00000100:00100000:0.0:1790391568.974610:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790391568.974617:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17199:x1877361186492288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391568.974628:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391568.974639:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e2273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e226c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.974660:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e2273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e226c expref: 18 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.974669:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e2273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e226c expref: 18 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.974677:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eef600, rc 0) 00000100:00100000:0.0:1790391568.974710:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17199:x1877361186492288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391568.974717:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790391568.974765:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186492288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391568.974778:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.974787:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391568.974836:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186492416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790391568.974862:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391568.974892:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93b840 going to sleep for 11 seconds 00000100:00100000:0.0:1790391568.974906:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186492416 00000100:00100000:0.0:1790391568.974910:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186492416 00000100:00100000:0.0:1790391568.974937:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790391568.974942:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17199:x1877361186492416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790391568.974954:0:17194:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790391568.974968:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790391568.974971:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1790391568.975037:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17199:x1877361186492416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391568.975044:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790391568.975072:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186492416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790391568.975108:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790391568.975114:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391568.975122:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391569.291576:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00000040:00080000:0.0:1790391569.487807:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790391569.937572:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391570.316465:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:3.0:1790391570.952477:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391571.340966:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00010000:00010000:2.0:1790391571.980209:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391572.361395:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 0 seconds 00000100:00080000:2.0:1790391572.488461:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790391572.488468:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790391572.488471:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391572.488484:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e5284eef000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391572.488523:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5284945180 x1877361186492672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391572.488536:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391572.488539:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391572.488542:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391572.488545:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391572.488568:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391572.488572:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790391572.488574:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391572.488577:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391572.488635:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186493056:0@lo:400:kworker.0 00000100:00100000:2.0:1790391572.488705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391572.488772:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391572.488779:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186492544:0@lo:400:kworker.0 00000100:00100000:2.0:1790391572.488808:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391572.488848:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186492544 00000100:00100000:2.0:1790391572.488856:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186492544 00000100:00100000:2.0:1790391572.488925:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790391572.488935:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:3637:x1877361186492544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391572.488986:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:3637:x1877361186492544:12345-0@lo:400:kworker.0 Request processed in 52us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391572.488994:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790391572.489043:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186492544:0@lo:400:kworker.0 00000100:00100000:3.0:1790391572.489334:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186492800:0@lo:400:kworker.0 00000100:00100000:3.0:1790391572.489367:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391572.489387:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790391572.489392:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186492928:0@lo:400:kworker.0 00000100:00100000:3.0:1790391572.489416:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391572.489447:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186493056 00000100:00100000:3.0:1790391572.489451:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186493056 00000100:00100000:3.0:1790391572.489479:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186492800 00000100:00100000:3.0:1790391572.489482:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186492800 00000100:00100000:3.0:1790391572.489495:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391572.489502:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186493056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391572.489543:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186493056:12345-0@lo:400:kworker.0 Request processed in 41us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391572.489549:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391572.489566:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391572.489572:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186492800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391572.489602:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186492800:12345-0@lo:400:kworker.0 Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391572.489607:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790391572.489628:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186492928 00000100:00100000:3.0:1790391572.489631:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186492928 00000100:00100000:3.0:1790391572.489655:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391572.489662:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186492928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391572.489696:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186492928:12345-0@lo:400:kworker.0 Request processed in 34us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391572.489703:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391572.489905:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186492928:0@lo:400:kworker.0 00010000:00080000:3.0:1790391572.489928:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5284944000 x1877361186492800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391572.489940:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186492800:0@lo:400:kworker.0 00010000:00080000:3.0:1790391572.489973:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5284946a00 x1877361186493056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391572.489981:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186493056:0@lo:400:kworker.0 00000100:00100000:1.0:1790391572.490129:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186492672:0@lo:38:kworker.0 00000100:00100000:1.0:1790391572.490165:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391572.490200:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186492672 00000100:00100000:1.0:1790391572.490204:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186492672 00000100:00100000:1.0:1790391572.490248:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391572.490252:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1877361186492672:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790391572.490281:0:17207:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:1.0:1790391572.490325:0:17207:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e227a 00000004:00100000:1.0:1790391572.490341:0:17207:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790391572.490349:0:17207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1790391572.493607:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186493184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391572.493695:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391572.494476:0:17206:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1790391572.494489:0:17206:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1790391572.495241:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186493184 00000100:00100000:2.0:1790391572.495251:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186493184 00000100:00100000:1.0:1790391572.495383:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391572.495394:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186493184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391572.495429:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790391572.495515:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186493184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391572.495523:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391572.496765:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186493184:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1790391572.498396:0:17207:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cfd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391572.498504:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1877361186492672:12345-0@lo:38:kworker.0 Request processed in 8248us (8336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391572.498516:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1790391572.498681:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790391572.498693:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790391572.498698:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790391572.498701:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5284eef000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1790391572.498733:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c1078ef1): req@ffff9e5183b7df80 x1877361186485760/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391572.498765:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186492672:0@lo:38:kworker.0 00000100:00100000:0.0:1790391572.498854:0:17243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391572.498906:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528929f540 going to sleep for 11 seconds 00000100:00100000:0.0:1790391572.498922:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186485760 00000100:00100000:0.0:1790391572.498929:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186485760 00000100:00100000:0.0:1790391572.498964:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391572.498972:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17243:x1877361186485760:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790391572.499041:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17243:x1877361186485760:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391572.499047:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391572.499071:0:17243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17243:1877361186485760:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1790391572.499102:0:17243:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790391572.499145:0:17243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17243:1877361186493312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790391572.499175:0:17243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391572.499467:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391572.499478:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186493440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391572.499506:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391572.502462:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186493312 00000100:00100000:3.0:1790391572.502476:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186493312 00000100:00100000:3.0:1790391572.502517:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186493440 00000100:00100000:3.0:1790391572.502521:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186493440 00000100:00100000:3.0:1790391572.502539:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790391572.502547:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17243:x1877361186493312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790391572.502953:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e99b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391572.504090:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790391572.504106:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186493440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391572.504138:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391572.504222:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3640:x1877361186493440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (4714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391572.504229:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391572.506206:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186493440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391572.510133:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17243:x1877361186493312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 7570us (10940us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391572.510149:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790391572.510337:0:17243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17243:1877361186493312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790391572.510510:0:17243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7dc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17243:1877361186493568:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790391572.510552:0:17243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391572.510590:0:17243:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b9bdba80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391572.510943:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186493568 00000100:00100000:1.0:1790391572.510952:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186493568 00000100:00100000:1.0:1790391572.511003:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391572.511013:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17243:x1877361186493568:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790391572.511097:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17243:x1877361186493568:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 85us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391572.511103:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391572.511133:0:17243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7dc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17243:1877361186493568:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1790391572.511189:0:17243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391572.513253:0:17243:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790391572.513341:0:17243:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1790391572.513347:0:17243:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:2.0:1790391572.669836:0:18203:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790391573.003087:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790391573.862434:0:18255:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391573.862619:0:18255:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790391574.024047:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391574.345684:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1790391574.711268:0:18305:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790391574.711500:0:18305:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790391575.048190:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790391575.908867:0:18354:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5d9035c0 20000000:00000080:0.0:1790391575.909039:0:18354:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e52872bb800 uarg=0000000000000000 20000000:01000000:0.0:1790391575.909087:0:18354:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790391575.909094:0:18354:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790391575.909098:0:18354:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790391575.909569:0:18355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1790391575.910564:0:18354:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790391575.916025:0:18354:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790391575.916411:0:18354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391575.916433:0:18354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e212a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2123 expref: 17 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391575.916442:0:18354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eef000/0x2b1b7949f13e222d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2226 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391575.916450:0:18354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391575.916505:0:18354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eef000/0x2b1b7949f13e222d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2226 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391575.916521:0:18354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52b5eef000/0x2b1b7949f13e222d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2226 expref: 17 pid: 17194 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391575.916535:0:18354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1877361186493696:0@lo:104: 00000100:00100000:2.0:1790391575.916599:0:18354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391575.916650:0:18354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e212a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2123 expref: 17 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391575.916658:0:18354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e212a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2123 expref: 17 pid: 17197 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391575.916679:0:18354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1877361186493824:0@lo:104: 00000100:00100000:2.0:1790391575.916711:0:18354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391575.916730:0:18354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b994e780 going to sleep for 11 seconds 00000100:00100000:0.0:1790391575.916829:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186493696 00000100:00100000:0.0:1790391575.916837:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186493696 00000100:00100000:0.0:1790391575.916872:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186493824 00000100:00100000:0.0:1790391575.916901:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186493824 00000100:00100000:0.0:1790391575.916917:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391575.916924:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+4:18354:x1877361186493696:12345-0@lo:104: 00010000:00010000:0.0:1790391575.916939:0:17185:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.916995:0:17185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790391575.917001:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+4:18354:x1877361186493696:12345-0@lo:104: Request processed in 77us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391575.917008:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391575.917023:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391575.917028:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:18354:x1877361186493824:12345-0@lo:104: 00010000:00010000:0.0:1790391575.917035:0:17185:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917063:0:17185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790391575.917068:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:18354:x1877361186493824:12345-0@lo:104: Request processed in 40us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391575.917073:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790391575.917088:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391575.917094:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917111:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391575.917116:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917124:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391575.917131:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391575.917137:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391575.917162:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917168:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391575.917184:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917191:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2226 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e222d expref: -99 pid: 17933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917206:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391575.917209:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917215:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:0.0:1790391575.917218:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917234:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790391575.917240:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391575.917246:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790391575.917257:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917272:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790391575.917284:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917291:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b763c600/0x2b1b7949f13e2123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e212a expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917303:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391575.917305:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391575.917306:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391575.917323:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391575.917333:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186493952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391575.917359:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391575.917387:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186494080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391575.917406:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391575.917436:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186493952 00000100:00100000:0.0:1790391575.917439:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186493952 00010000:00010000:0.0:1790391575.917454:0:17188:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eef000/0x2b1b7949f13e222d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2226 expref: 18 pid: 17194 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391575.917481:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186494080 00000100:00100000:0.0:1790391575.917484:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186494080 00010000:00010000:0.0:1790391575.917493:0:17188:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e212a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2123 expref: 19 pid: 17197 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391575.917515:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391575.917520:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:3639:x1877361186493952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391575.917530:0:17188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391575.917534:0:17188:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eef000/0x2b1b7949f13e222d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2226 expref: 19 pid: 17194 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917544:0:17188:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eef000/0x2b1b7949f13e222d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2226 expref: 19 pid: 17194 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917557:0:17188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391575.917580:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:3639:x1877361186493952:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391575.917586:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391575.917596:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391575.917601:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:3637:x1877361186494080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391575.917607:0:17188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391575.917610:0:17188:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e212a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2123 expref: 18 pid: 17197 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917619:0:17188:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e212a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2123 expref: 18 pid: 17197 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917629:0:17188:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917642:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917653:0:17188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917660:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917668:0:17188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917675:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917680:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054c00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391575.917697:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917706:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917714:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391575.917722:0:17188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391575.917746:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:3637:x1877361186494080:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391575.917752:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391575.917788:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186494080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391575.917816:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186493952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790391575.918001:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391575.918182:0:18354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eef000/0x2b1b7949f13e222d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2226 expref: 17 pid: 17194 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391575.918192:0:18354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1877361186493696:0@lo:104: 00010000:00010000:2.0:1790391575.918201:0:18354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184055800/0x2b1b7949f13e212a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2123 expref: 16 pid: 17197 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391575.918208:0:18354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1877361186493824:0@lo:104: 00010000:00010000:2.0:1790391575.918224:0:18354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391575.918232:0:18354:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391575.918239:0:18354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391575.918245:0:18354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e2281 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391576.073963:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391577.108148:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391577.613155:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186494208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391577.613236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391577.613308:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186494208 00000100:00100000:0.0:1790391577.613316:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186494208 00000100:00100000:0.0:1790391577.613364:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790391577.613373:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186494208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790391577.613408:0:17207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790391577.613649:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186494208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 275us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391577.613657:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790391577.613713:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186494208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391577.615551:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391567/real 1790391567] req@ffff9e5284945500 x1877361186488960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391577.615583:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5284945500 x1877361186488960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391577.615617:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391567/real 1790391567] req@ffff9e52bf949500 x1877361186488704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391577.615632:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e52bf949500 x1877361186488704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391577.615641:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391562/real 1790391562] req@ffff9e5183a43480 x1877361186486784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391577.615651:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5183a43480 x1877361186486784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391577.615659:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391562/real 1790391562] req@ffff9e5183a41f80 x1877361186486912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391577.615680:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e5183a41f80 x1877361186486912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391577.615697:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391577.615706:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391577.615710:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186488960:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790391577.615715:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528765e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391577.615719:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391577.615721:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186488704:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790391577.615725:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183375000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391577.615728:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391577.615731:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186486784:0@lo:8:kworker.0 00000100:00080000:2.0:1790391577.615745:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391577.615750:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790391577.615753:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186486912:0@lo:8:kworker.0 00000100:00080000:0.0:1790391577.616005:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391577.616009:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790391577.616012:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e5183375000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391577.616018:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:0.0:1790391577.616024:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790391577.616030:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5183375000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391577.616059:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf94a300 x1877361186494592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391577.616074:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391577.616087:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790391577.616089:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391577.616100:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:0.0:1790391577.616102:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790391577.616106:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5183835000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391577.616118:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf949c00 x1877361186494720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391577.616141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391577.616154:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790391577.616156:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e528765e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391577.616159:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:0.0:1790391577.616162:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790391577.616165:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e528765e000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391577.616176:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf94ad80 x1877361186494976/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391577.616183:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391577.616186:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790391577.616188:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391577.616191:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:0.0:1790391577.616193:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790391577.616196:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e51838d2800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391577.616207:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf949180 x1877361186495104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790391577.616237:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186494336:0@lo:400:kworker.0 00000100:00100000:0.0:1790391577.616701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391577.616744:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391577.616758:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186494464:0@lo:400:kworker.0 00000100:00100000:0.0:1790391577.616786:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391577.616825:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186494336 00000100:00100000:0.0:1790391577.616833:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186494336 00000100:00100000:0.0:1790391577.616907:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790391577.616917:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+16:3639:x1877361186494336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391577.616966:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+16:3639:x1877361186494336:12345-0@lo:400:kworker.0 Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391577.616974:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790391577.617005:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186494464 00000100:00100000:0.0:1790391577.617009:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186494464 00000100:00100000:0.0:1790391577.617033:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790391577.617040:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186494464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391577.617071:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186494464:12345-0@lo:400:kworker.0 Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391577.617213:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790391577.617239:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186494848:0@lo:400:kworker.0 00000100:00100000:0.0:1790391577.617341:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391577.617364:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391577.617371:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186495232:0@lo:400:kworker.0 00000100:00100000:0.0:1790391577.617393:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391577.617421:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186494848 00000100:00100000:0.0:1790391577.617425:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186494848 00000100:00100000:0.0:1790391577.617613:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186495232 00000100:00100000:0.0:1790391577.617617:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186495232 00000100:00100000:3.0:1790391577.622548:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186495360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391577.622633:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391577.622705:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186494464:0@lo:400:kworker.0 00000100:00100000:3.0:1790391577.622719:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186494336:0@lo:400:kworker.0 00000100:00100000:3.0:1790391577.622768:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186495360 00000100:00100000:3.0:1790391577.622774:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186495360 00000100:00100000:3.0:1790391577.622822:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391577.622831:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186495360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790391577.622870:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790391577.622944:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186495360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391577.622950:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391577.622982:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186494592:0@lo:8:kworker.0 00000400:00000100:3.0:1790391577.623003:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186494592 offset 0 length 520: 4 00000100:00100000:3.0:1790391577.623026:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186494720:0@lo:8:kworker.0 00000400:00000100:3.0:1790391577.623043:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186494720 offset 0 length 520: 4 00000100:00100000:3.0:1790391577.623053:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186494976:0@lo:8:kworker.0 00000400:00000100:3.0:1790391577.623066:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186494976 offset 0 length 520: 4 00000100:00100000:3.0:1790391577.623075:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186495104:0@lo:8:kworker.0 00000400:00000100:3.0:1790391577.623092:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877361186495104 offset 0 length 520: 4 00000100:00100000:3.0:1790391577.623124:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186495360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391577.626309:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391577.626338:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186494848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391577.627321:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186494848:12345-0@lo:400:kworker.0 Request processed in 991us (9971us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391577.627331:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391577.627362:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391577.627371:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186495232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391577.627413:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186495232:12345-0@lo:400:kworker.0 Request processed in 44us (10018us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391577.627420:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790391577.627706:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e52bf94bb80 x1877361186495232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391577.627723:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186495232:0@lo:400:kworker.0 00010000:00080000:1.0:1790391577.627739:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e52bf948380 x1877361186494848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391577.627765:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186494848:0@lo:400:kworker.0 10000000:01000000:0.0:1790391577.737613:0:17199:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790391577.737622:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5288361800 from 13 10000000:01000000:0.0:1790391577.737627:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790391577.737699:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391577.737712:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391577.737723:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391577.737749:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186495488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391577.737818:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391577.737865:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93b540 going to sleep for 11 seconds 00000100:00100000:2.0:1790391577.737980:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186495488 00000100:00100000:2.0:1790391577.737989:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186495488 00000100:00100000:2.0:1790391577.738038:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391577.738046:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+16:17199:x1877361186495488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391577.738058:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391577.738071:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e228f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2288 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.738093:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e228f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2288 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.738103:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e228f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2288 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.738124:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184054c00, rc 0) 00000100:00100000:2.0:1790391577.738164:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17199:x1877361186495488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391577.738170:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391577.738213:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186495488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391577.738228:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.738237:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391577.738298:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186495616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391577.738324:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391577.738343:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b994ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391577.738356:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186495616 00000100:00100000:2.0:1790391577.738359:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186495616 00000100:00100000:2.0:1790391577.738382:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790391577.738388:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17199:x1877361186495616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391577.738511:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17199:x1877361186495616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391577.738517:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790391577.738545:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186495616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391577.738569:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186495744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391577.738602:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391577.738618:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b994ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790391577.738627:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186495744 00000100:00100000:2.0:1790391577.738630:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186495744 00000100:00100000:2.0:1790391577.738646:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391577.738651:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17199:x1877361186495744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790391577.738725:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17199:x1877361186495744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391577.738731:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391577.738766:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186495744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790391577.739447:0:18422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790391577.739504:0:17199:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790391577.739521:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790391577.739530:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.739540:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391577.739549:0:17199:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790391577.739552:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5284dc3000 from 13 10000000:01000000:2.0:1790391577.739554:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391577.739584:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.739591:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.739599:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391577.739627:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186495872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391577.739676:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391577.739695:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b9bdb240 going to sleep for 11 seconds 00000100:00100000:2.0:1790391577.739710:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186495872 00000100:00100000:2.0:1790391577.739715:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186495872 00000100:00100000:2.0:1790391577.739745:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790391577.739752:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+17:17199:x1877361186495872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391577.739761:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391577.739773:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e229d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2296 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.739801:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e229d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2296 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.739811:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e229d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2296 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.739819:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055200, rc 0) 00000100:00100000:2.0:1790391577.739850:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17199:x1877361186495872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391577.739855:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790391577.739903:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186495872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790391577.739914:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391577.739923:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391577.739973:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186496000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391577.739996:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391577.740134:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b9bdb240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391577.748908:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186496000 00000100:00100000:3.0:1790391577.748929:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186496000 00000100:00100000:3.0:1790391577.749005:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790391577.749015:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17199:x1877361186496000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391577.749202:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17199:x1877361186496000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (9203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391577.749222:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790391577.749373:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186496000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391577.749425:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186496128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391577.749472:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391577.749511:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528754f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391577.749719:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186496128 00000100:00100000:3.0:1790391577.749724:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186496128 00000100:00100000:3.0:1790391577.749756:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790391577.749763:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17199:x1877361186496128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391577.750625:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:17199:x1877361186496128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 858us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391577.750636:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790391577.756801:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186496128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790391577.758253:0:18423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790391577.758427:0:17199:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790391577.758450:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391577.758462:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391577.758474:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391578.125177:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790391578.650040:0:17934:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790391579.147128:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391579.723587:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790391580.168069:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391581.193020:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391582.216247:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790391582.732801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391582.732808:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391582.732811:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391582.732814:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391582.732831:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391582.732846:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391582.732849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391582.732852:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790391582.733052:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186496256:0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.733123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391582.733173:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186496768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391582.733201:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391582.733227:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790391582.733232:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186496640:0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.733303:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391582.733332:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186496384:0@lo:400:kworker.0 00000100:00100000:1.0:1790391582.733347:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186496256 00000100:00100000:1.0:1790391582.733355:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186496256 00000100:00100000:0.0:1790391582.733356:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391582.733373:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186496896:0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.733393:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391582.733409:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391582.733414:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186496512:0@lo:400:kworker.0 00000100:00100000:1.0:1790391582.733415:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790391582.733423:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:3640:x1877361186496256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.733432:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391582.733460:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186496768 00000100:00100000:0.0:1790391582.733464:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186496768 00000100:00100000:1.0:1790391582.733474:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:3640:x1877361186496256:12345-0@lo:400:kworker.0 Request processed in 52us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391582.733482:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790391582.733483:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186496640 00000100:00100000:0.0:1790391582.733485:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186496640 00000100:00100000:0.0:1790391582.733492:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186496384 00000100:00100000:0.0:1790391582.733494:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186496384 00000100:00100000:0.0:1790391582.733505:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391582.733511:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1877361186496768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790391582.733551:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790391582.733586:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1877361186496768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391582.733592:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790391582.733605:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391582.733611:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186496640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.733653:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186496640:12345-0@lo:400:kworker.0 Request processed in 42us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391582.733660:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391582.733670:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391582.733676:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186496384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.733711:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186496384:12345-0@lo:400:kworker.0 Request processed in 35us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391582.733717:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790391582.733750:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186496896 00000100:00100000:0.0:1790391582.733753:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186496896 00000100:00100000:0.0:1790391582.733774:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186496512 00000100:00100000:0.0:1790391582.733776:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186496512 00000100:00100000:0.0:1790391582.733787:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391582.733792:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186496896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.733821:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186496896:12345-0@lo:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391582.733827:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391582.733837:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790391582.733843:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186496512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.733868:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186496512:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391582.733897:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790391582.733939:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186496640:0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.733947:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186496256:0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.733958:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186496768:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1790391582.734543:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e52bf949f80 x1877361186496512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391582.734556:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186496512:0@lo:400:kworker.0 00000100:00100000:1.0:1790391582.734567:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186496384:0@lo:400:kworker.0 00010000:00080000:1.0:1790391582.734577:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e529233aa00 x1877361186496896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391582.734586:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186496896:0@lo:400:kworker.0 00000100:00100000:0.0:1790391582.737138:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391582.737160:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186497024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391582.737226:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391582.737274:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186497024 00000100:00100000:0.0:1790391582.737281:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186497024 00000100:00100000:0.0:1790391582.737326:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391582.737335:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186497024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391582.737366:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391582.737418:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186497024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391582.737425:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790391582.737465:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186497024:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790391583.240038:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790391583.792310:0:18702:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790391583.792315:0:18702:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790391583.792317:0:18702:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790391583.792433:0:18702:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e52878bb800 00000020:01000004:3.0:1790391583.792448:0:18702:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790391583.792461:0:18702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790391583.792474:0:18702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e52b9d73380) 00000020:00000080:3.0:1790391583.792490:0:18702:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790391583.840493:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790391583.843843:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790391583.844127:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790391583.844457:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790391583.844653:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790391583.845376:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790391583.845584:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1790391583.847283:0:18702:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790391583.847512:0:18702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790391583.847526:0:18702:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790391583.847539:0:18702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2b1b7949f13e22ab 00000020:01000004:2.0:1790391583.847546:0:18702:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790391583.847568:0:18702:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790391583.847572:0:18702:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790391583.847578:0:18702:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790391583.847582:0:18702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790391583.847592:0:18702:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e5183383380) 00000020:00000080:2.0:1790391583.847623:0:18702:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1790391583.849311:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391583.849493:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790391583.849499:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790391583.855524:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790391583.855538:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790391583.858852:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790391583.858865:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790391583.863559:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790391583.864495:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790391583.864504:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790391583.865552:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790391583.865562:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790391583.893113:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391583.893450:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790391583.893457:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1790391583.895394:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790391583.895408:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1790391583.896402:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790391583.896413:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1790391583.899127:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790391583.899569:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1790391583.899573:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1790391583.902341:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1790391583.902360:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790391583.948940:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790391583.949155:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790391583.949162:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790391583.951090:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790391583.951105:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790391583.952446:0:18702:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790391583.952549:0:18702:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1790391583.952557:0:18702:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790391583.964323:0:18702:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790391583.964359:0:18702:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.128@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1790391583.964363:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790391583.964364:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790391583.964365:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391583.964366:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391583.964367:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391583.964367:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391583.964368:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790391583.964369:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391583.964370:0:18702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790391583.964373:0:18702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1790391583.964374:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790391583.964375:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790391583.964375:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790391583.964376:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790391583.964377:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790391583.964377:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790391583.964378:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790391583.964379:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790391583.964379:0:18702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790391583.964408:0:18702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790391583.964425:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497152:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790391583.964486:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391583.964535:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254180 going to sleep for 11 seconds 00000100:00100000:2.0:1790391583.964600:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186497152 00000100:00100000:2.0:1790391583.964617:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186497152 00000100:00100000:2.0:1790391583.964677:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790391583.964684:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:18702:x1877361186497152:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790391583.964716:0:17194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790391583.964718:0:17194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1790391583.964721:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790391583.967775:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:18702:x1877361186497152:12345-0@lo:253:mount.lustre.0 Request processed in 3079us (3277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391583.967792:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790391583.968026:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497152:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790391583.968045:0:18702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790391583.968048:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391583.968050:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790391583.968051:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391583.968052:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391583.968053:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391583.968055:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391583.968057:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391583.968059:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391583.968060:0:18702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790391583.968085:0:18702:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e52878bb800 from lustre-OST0000 10000000:01000000:0.0:1790391583.968117:0:18702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790391583.968120:0:18702:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790391583.968129:0:18702:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e52b5cacd40 local copy 00010000:00010000:0.0:1790391583.968140:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391583.968377:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391583.968416:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391583.968507:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790391583.968550:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186497280 00000100:00100000:2.0:1790391583.968557:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186497280 00000100:00100000:2.0:1790391583.968654:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790391583.968664:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:18702:x1877361186497280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391583.968750:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:18702:x1877361186497280:12345-0@lo:501:mount.lustre.0 Request processed in 87us (333us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790391583.968758:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790391583.968819:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497280:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790391583.968832:0:18702:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790391583.968848:0:18702:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790391583.968854:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391583.968863:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391583.968929:0:18702:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e52878bb800 10000000:01000000:0.0:1790391583.968934:0:18702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790391583.968939:0:18702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790391583.968941:0:18702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790391583.968945:0:18702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790391583.968949:0:18702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790391583.968970:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391583.968979:0:18702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391583.968989:0:18702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391583.969001:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790391583.969026:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391583.969209:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93c240 going to sleep for 11 seconds 00000100:00100000:1.0:1790391583.969386:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186497408 00000100:00100000:1.0:1790391583.969391:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186497408 00000100:00100000:1.0:1790391583.969415:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790391583.969422:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+18:18702:x1877361186497408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391583.969431:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391583.969443:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5183086a00/0x2b1b7949f13e22c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e22b9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391583.969477:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183086a00/0x2b1b7949f13e22c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e22b9 expref: 19 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391583.969488:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5183086a00/0x2b1b7949f13e22c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e22b9 expref: 19 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391583.969497:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086a00, rc 0) 00000100:00100000:1.0:1790391583.969535:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186497408:12345-0@lo:101:mount.lustre.0 Request processed in 113us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391583.969541:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790391583.969643:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790391583.969656:0:18702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391583.969666:0:18702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391583.971085:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1790391583.971853:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391583.978991:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1790391583.979060:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1790391583.979075:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1790391583.979088:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1790391583.979101:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1790391583.979114:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1790391583.979139:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1790391583.979145:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1790391583.979259:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391583.979326:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391583.979380:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aea80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391583.979486:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186497536 00000100:00100000:1.0:1790391583.979494:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186497536 00000100:00100000:1.0:1790391583.979550:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790391583.979560:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186497536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391583.980028:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186497536:12345-0@lo:501:mount.lustre.0 Request processed in 468us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391583.980036:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790391583.980437:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391583.980474:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391583.980522:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391583.980543:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aea80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391583.980591:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186497664 00000100:00100000:1.0:1790391583.980596:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186497664 00000100:00100000:1.0:1790391583.980672:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790391583.980680:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186497664:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391583.981698:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186497664:12345-0@lo:503:mount.lustre.0 Request processed in 1014us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391583.981708:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790391583.981931:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497664:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790391583.982416:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391583.982501:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497792:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391583.982549:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391583.982967:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e529e93c240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391583.983032:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186497792 00000100:00100000:3.0:1790391583.983039:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186497792 00000100:00100000:3.0:1790391583.983076:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790391583.983084:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186497792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391583.983533:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186497792:12345-0@lo:502:mount.lustre.0 Request processed in 448us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391583.983541:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790391583.983639:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391583.983858:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790391583.983922:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790391583.983938:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790391583.983964:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790391583.983979:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790391583.983994:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790391583.984008:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790391583.984022:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790391583.984056:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1790391583.984071:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1790391583.984083:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1790391583.984095:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1790391583.984126:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391583.984166:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391583.984205:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52953faa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391583.984424:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186497920 00000100:00100000:3.0:1790391583.984430:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186497920 00000100:00100000:3.0:1790391583.984457:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790391583.984463:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186497920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391583.984548:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186497920:12345-0@lo:502:mount.lustre.0 Request processed in 85us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391583.984555:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790391583.984639:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186497920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391583.984682:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1790391583.984690:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1790391583.985562:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790391583.985572:0:18719:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1790391583.985578:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391583.985581:0:18719:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790391583.985586:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790391583.985601:0:18719:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e5183384d40) 00000020:00000080:2.0:1790391583.985633:0:18719:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790391583.985639:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790391583.985711:0:18719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52878bb800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790391583.985720:0:18719:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790391583.985726:0:18719:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2b1b7949f13e22ce 00010000:00010000:2.0:1790391583.990159:0:18719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1790391583.990660:0:18719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1790391583.992183:0:18719:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1790391583.993572:0:18719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790391583.993584:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391583.993595:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391583.993597:0:18719:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790391583.993601:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790391583.993603:0:18719:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1790391583.993605:0:18719:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391583.993618:0:18719:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790391583.993620:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790391583.993623:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391583.993624:0:18719:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790391583.993627:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391583.993630:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391583.993632:0:18719:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790391583.993635:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391583.993636:0:18719:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790391583.993638:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391583.993641:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391583.993642:0:18719:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790391583.993644:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391583.993646:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391583.993647:0:18719:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790391583.993650:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790391583.993678:0:18719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391583.993681:0:18719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391583.993683:0:18719:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790391583.993686:0:18719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1790391583.998985:0:18702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1790391583.999037:0:18702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790391583.999055:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391583.999068:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef800/0x2b1b7949f13e22b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22c0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391583.999338:0:18702:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52878bb800 from 1 10000000:01000000:2.0:1790391583.999343:0:18702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790391583.999384:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391583.999394:0:18702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391583.999406:0:18702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391583.999445:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790391583.999513:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391583.999556:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391583.999625:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186498048 00000100:00100000:3.0:1790391583.999632:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186498048 00000100:00100000:3.0:1790391583.999682:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790391583.999691:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186498048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391583.999703:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391583.999715:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e22dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e22d5 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391583.999740:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e22dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e22d5 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391583.999750:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e22dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e22d5 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391583.999769:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d600, rc 0) 00000100:00100000:3.0:1790391583.999815:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:18702:x1877361186498048:12345-0@lo:101:mount.lustre.0 Request processed in 125us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391583.999822:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790391583.999971:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790391583.999986:0:18702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391583.999996:0:18702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790391584.001011:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1790391584.001282:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790391584.001468:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1790391584.001494:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1790391584.001512:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1790391584.001517:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1790391584.001581:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391584.001653:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391584.001739:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391584.004318:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186498176 00000100:00100000:0.0:1790391584.004334:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186498176 00000100:00100000:0.0:1790391584.004915:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790391584.004928:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:18702:x1877361186498176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391584.005093:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:18702:x1877361186498176:12345-0@lo:501:mount.lustre.0 Request processed in 168us (3439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391584.005101:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790391584.005210:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391584.005261:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391584.005308:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391584.005864:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820d180 going to sleep for 11 seconds 00000100:00100000:3.0:1790391584.006019:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186498304 00000100:00100000:3.0:1790391584.006025:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186498304 00000100:00100000:3.0:1790391584.006057:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790391584.006065:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:18702:x1877361186498304:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391584.006317:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:18702:x1877361186498304:12345-0@lo:503:mount.lustre.0 Request processed in 252us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391584.006325:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790391584.006411:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498304:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790391584.006822:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391584.007064:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391584.007111:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391584.007200:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391584.007289:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186498432 00000100:00100000:0.0:1790391584.007296:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186498432 00000100:00100000:0.0:1790391584.007365:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790391584.007374:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:18702:x1877361186498432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391584.007475:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:18702:x1877361186498432:12345-0@lo:502:mount.lustre.0 Request processed in 102us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391584.007491:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790391584.007556:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391584.007743:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790391584.007770:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790391584.007785:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790391584.007797:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790391584.007808:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790391584.007820:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790391584.007832:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790391584.007845:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1790391584.007910:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790391584.007930:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1790391584.007943:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1790391584.007967:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498560:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391584.008004:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391584.008290:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790391584.008320:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186498560 00000100:00100000:3.0:1790391584.008326:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186498560 00000100:00100000:3.0:1790391584.008354:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790391584.008360:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:18702:x1877361186498560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391584.008449:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:18702:x1877361186498560:12345-0@lo:502:mount.lustre.0 Request processed in 88us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391584.008455:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790391584.008533:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391584.008575:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1790391584.008582:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790391584.009365:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391584.009376:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391584.009379:0:18723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790391584.009387:0:18723:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52878bb800 00000020:00000080:2.0:1790391584.009389:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790391584.009397:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391584.009399:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391584.009401:0:18723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790391584.009410:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391584.009413:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391584.009415:0:18723:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790391584.009418:0:18723:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52878bb800 00000020:00000080:2.0:1790391584.009420:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790391584.009481:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391584.009485:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391584.009486:0:18723:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790391584.009489:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391584.009491:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391584.009492:0:18723:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790391584.009495:0:18723:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52878bb800 00000020:00000080:2.0:1790391584.009497:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790391584.009515:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391584.009518:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391584.009519:0:18723:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790391584.009522:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391584.009524:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391584.009525:0:18723:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790391584.009528:0:18723:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52878bb800 00000020:00000080:2.0:1790391584.009529:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790391584.009548:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391584.009551:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391584.009552:0:18723:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790391584.009555:0:18723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1790391584.020734:0:18702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790391584.020784:0:18702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391584.020811:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391584.020826:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391584.020923:0:18702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790391584.020926:0:18702:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e52878bb800 10000000:01000000:3.0:1790391584.020930:0:18702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e52878bb800 10000000:01000000:3.0:1790391584.020934:0:18702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790391584.020940:0:18702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52878bb800 from 1 10000000:01000000:3.0:1790391584.020943:0:18702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790391584.020979:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391584.020988:0:18702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391584.021000:0:18702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391584.021024:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790391584.021088:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391584.021134:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186498688 00000100:00100000:3.0:1790391584.021142:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186498688 00000100:00100000:3.0:1790391584.022287:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790391584.022305:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:18702:x1877361186498688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391584.022321:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391584.022336:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b763c000/0x2b1b7949f13e22ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e22e3 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391584.022363:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b763c000/0x2b1b7949f13e22ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e22e3 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391584.022386:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b763c000/0x2b1b7949f13e22ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e22e3 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391584.022396:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c000, rc 0) 00000100:00100000:3.0:1790391584.022448:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186498688:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391584.022455:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790391584.022513:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518225e780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391584.022540:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391584.022557:0:18702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391584.022567:0:18702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790391584.026299:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790391584.026587:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790391584.026823:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790391584.026849:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790391584.026863:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790391584.030333:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790391584.030425:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790391584.030443:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790391584.030456:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790391584.030470:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790391584.030484:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790391584.030496:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790391584.030511:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790391584.030545:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790391584.030559:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790391584.030572:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790391584.030585:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790391584.033472:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790391584.033514:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790391584.033530:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790391584.033543:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790391584.033557:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790391584.033570:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790391584.033583:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790391584.033596:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790391584.033624:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790391584.033639:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1790391584.033650:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1790391584.033663:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1790391584.033676:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1790391584.033689:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1790391584.033703:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1790391584.033717:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1790391584.033752:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1790391584.033768:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1790391584.033779:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1790391584.033791:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1790391584.033804:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1790391584.033817:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1790391584.033844:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1790391584.033850:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790391584.033989:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391584.034057:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391584.034111:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518225e240 going to sleep for 11 seconds 00000100:00100000:2.0:1790391584.034415:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186498816 00000100:00100000:2.0:1790391584.034424:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186498816 00000100:00100000:2.0:1790391584.034477:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790391584.034486:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186498816:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391584.034637:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186498816:12345-0@lo:501:mount.lustre.0 Request processed in 151us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391584.034645:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790391584.034754:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391584.034802:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391584.034844:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391584.034868:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186498944 00000100:00100000:3.0:1790391584.034872:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186498944 00000100:00100000:3.0:1790391584.037715:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790391584.037728:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186498944:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391584.037891:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186498944:12345-0@lo:503:mount.lustre.0 Request processed in 150us (3031us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391584.037900:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790391584.037955:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518225e240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391584.037982:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186498944:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790391584.038436:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790391584.038516:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186499072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391584.038570:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391584.038621:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186499072 00000100:00100000:3.0:1790391584.038629:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186499072 00000100:00100000:3.0:1790391584.038662:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391584.038669:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186499072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391584.038762:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186499072:12345-0@lo:502:mount.lustre.0 Request processed in 93us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391584.038769:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790391584.038805:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518225e780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391584.038820:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186499072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790391584.039012:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790391584.039036:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790391584.039060:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790391584.039074:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790391584.039087:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790391584.039102:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790391584.039114:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790391584.039140:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790391584.039156:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790391584.039169:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790391584.039180:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790391584.039192:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790391584.039202:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790391584.039213:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790391584.039224:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790391584.039235:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790391584.039246:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790391584.039258:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790391584.039271:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790391584.039282:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790391584.039294:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790391584.039306:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790391584.039319:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790391584.039345:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790391584.039360:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1790391584.039374:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1790391584.039387:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1790391584.039399:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1790391584.039409:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1790391584.039422:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1790391584.039433:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1790391584.039446:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1790391584.039459:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1790391584.039472:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1790391584.039483:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1790391584.039507:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1790391584.039519:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1790391584.039530:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1790391584.039543:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1790391584.039568:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1790391584.039581:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1790391584.039594:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1790391584.044894:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1790391584.044968:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1790391584.044983:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1790391584.044996:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1790391584.045008:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1790391584.045020:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1790391584.045075:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186499200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391584.045156:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391584.045292:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186499200 00000100:00100000:2.0:1790391584.045300:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186499200 00000100:00100000:2.0:1790391584.045350:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790391584.045358:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186499200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391584.045468:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186499200:12345-0@lo:502:mount.lustre.0 Request processed in 110us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391584.045476:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790391584.045718:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518225e780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391584.045739:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186499200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790391584.045964:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1790391584.045988:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1790391584.046013:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186499328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391584.046050:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391584.046068:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518225e780 going to sleep for 11 seconds 00000100:00100000:2.0:1790391584.046134:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186499328 00000100:00100000:2.0:1790391584.046139:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186499328 00000100:00100000:2.0:1790391584.046171:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790391584.046178:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186499328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391584.046267:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186499328:12345-0@lo:502:mount.lustre.0 Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391584.046274:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790391584.046445:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186499328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790391584.046483:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1790391584.046492:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790391584.050158:0:18728:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790391584.050178:0:18728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e52ba408000) 00000020:00000080:1.0:1790391584.050217:0:18728:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1790391584.050305:0:18728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52878bb800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790391584.050309:0:18728:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52878bb800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790391584.050310:0:18728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52878bb800 3 00010000:00080000:1.0:1790391584.050334:0:18728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e5182dd9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.128@tcp at head 00010000:00010000:1.0:1790391584.051737:0:18728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1790391584.051951:0:18728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790391584.051992:0:18728:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790391584.052004:0:18728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2b1b7949f13e22f8 00000100:00080000:1.0:1790391584.052015:0:18728:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790391584.052020:0:18728:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e5182dd9800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:1.0:1790391584.052055:0:18728:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183b7c700 x1877361186499456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790391584.052079:0:18728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790391584.053286:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186499456:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790391584.053347:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790391584.053766:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391584.053770:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391584.053772:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391584.053775:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391584.053797:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391584.053801:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391584.053803:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391584.053806:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790391584.053829:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186499584:0@lo:400:kworker.0 00000100:00100000:0.0:1790391584.053862:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391584.053909:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391584.053916:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186499712:0@lo:400:kworker.0 00000100:00100000:0.0:1790391584.053940:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391584.053979:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186499840:0@lo:400:kworker.0 00000100:00100000:0.0:1790391584.054002:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391584.054019:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790391584.054025:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186499968:0@lo:400:kworker.0 00000100:00100000:0.0:1790391584.054045:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391584.054096:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186499584 00000100:00100000:0.0:1790391584.054103:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186499584 00000100:00100000:0.0:1790391584.054139:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186499840 00000100:00100000:0.0:1790391584.054142:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186499840 00000100:00100000:0.0:1790391584.054161:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790391584.054166:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186499584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391584.054293:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186499584:12345-0@lo:400:kworker.0 Request processed in 52us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391584.054299:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790391584.054313:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790391584.054317:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186499840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391584.054344:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186499840:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391584.054350:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790391584.054373:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186499456 00000100:00100000:0.0:1790391584.054376:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186499456 00000100:00100000:0.0:1790391584.054387:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186499712 00000100:00100000:0.0:1790391584.054390:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186499712 00000100:00100000:0.0:1790391584.054403:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186499968 00000100:00100000:0.0:1790391584.054406:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186499968 00000100:00100000:0.0:1790391584.054415:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391584.054419:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186499712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391584.054440:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186499712:12345-0@lo:400:kworker.0 Request processed in 21us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391584.054443:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391584.054450:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391584.054453:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186499968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391584.054466:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186499968:12345-0@lo:400:kworker.0 Request processed in 13us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391584.054470:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391584.054475:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790391584.054485:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186499456:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790391584.054508:0:17202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:0.0:1790391584.054548:0:17202:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2b1b7949f13e22ff 00000004:00100000:0.0:1790391584.054560:0:17202:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790391584.054583:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9e52878fb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391584.054624:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1877361186499456:12345-0@lo:38:llog_process_th.0 Request processed in 138us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391584.054631:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790391584.054668:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5292339880 x1877361186499968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391584.054681:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186499968:0@lo:400:kworker.0 00000100:00100000:0.0:1790391584.054689:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186499840:0@lo:400:kworker.0 00010000:00080000:0.0:1790391584.054708:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5292339c00 x1877361186499712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391584.054713:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186499712:0@lo:400:kworker.0 00000100:00100000:0.0:1790391584.054718:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186499584:0@lo:400:kworker.0 00010000:00080000:2.0:1790391584.055111:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5183b7c700 x1877361186499456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391584.055117:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790391584.055123:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790391584.055129:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790391584.055133:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790391584.055134:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5182dd9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790391584.055138:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1877361186499456:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1790391584.057239:0:18728:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790391584.057268:0:18728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e5182df4d40) 00000020:00000080:0.0:1790391584.057296:0:18728:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1790391584.057383:0:18728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52878bb800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790391584.057388:0:18728:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52878bb800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790391584.057390:0:18728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52878bb800 3 00010000:00080000:0.0:1790391584.057419:0:18728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52878fd800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.128@tcp at head 00010000:00010000:0.0:1790391584.059040:0:18728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1790391584.059496:0:18728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1790391584.059548:0:18728:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790391584.059561:0:18728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2b1b7949f13e230d 00000100:00080000:0.0:1790391584.059572:0:18728:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391584.059578:0:18728:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e52878fd800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391584.059627:0:18728:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5292339f80 x1877361186500096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391584.059646:0:18728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790391584.059670:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391584.059675:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391584.059677:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391584.059680:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391584.059683:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391584.059686:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391584.059688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391584.059691:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790391584.059904:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1877361186500096:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790391584.059993:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391584.062263:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186500096 00000100:00100000:0.0:1790391584.062280:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186500096 00000100:00100000:0.0:1790391584.062371:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790391584.062379:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186500096:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790391584.062412:0:17202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:0.0:1790391584.062464:0:17202:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2b1b7949f13e2314 00000004:00100000:0.0:1790391584.062480:0:17202:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790391584.062514:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9e52878fb800 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1790391584.063402:0:18728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1790391584.063567:0:18702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790391584.063601:0:18702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790391584.063628:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.063639:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b763cc00/0x2b1b7949f13e22e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e22ea expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790391584.063687:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790391584.063689:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790391584.063691:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391584.063691:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391584.063693:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391584.063694:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391584.063696:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391584.063698:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391584.063699:0:18702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391584.063703:0:18702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790391584.063706:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790391584.063707:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790391584.063709:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391584.063710:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391584.063711:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391584.063712:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391584.063713:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391584.063714:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391584.063715:0:18702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790391584.063738:0:18702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790391584.063759:0:18702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186500224:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790391584.063817:0:18702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391584.063858:0:18702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528820db40 going to sleep for 11 seconds 00000100:00100000:3.0:1790391584.067779:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186500224 00000100:00100000:3.0:1790391584.067798:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186500224 00000100:00100000:3.0:1790391584.067862:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790391584.067872:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:18702:x1877361186500224:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790391584.067930:0:17197:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790391584.067945:0:17197:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790391584.069327:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1877361186500096:12345-0@lo:38:llog_process_th.0 Request processed in 6940us (9327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391584.069350:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790391584.070465:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e5292339f80 x1877361186500096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391584.070498:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790391584.070509:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790391584.070518:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790391584.070523:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790391584.070526:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52878fd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790391584.070534:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1877361186500096:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1790391584.074461:0:17197:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790391584.074483:0:17197:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1790391584.074651:0:17217:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790391584.074657:0:17217:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790391584.074678:0:17217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391584.074697:0:17217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eee400/0x2b1b7949f13e2265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e225e expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391584.074705:0:17217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e2273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e226c expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391584.074712:0:17217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391584.074751:0:17217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e2273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e226c expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391584.074775:0:17217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e2273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e226c expref: 21 pid: 17197 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391584.074790:0:17217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186500352:0@lo:104: 00000100:00100000:1.0:1790391584.074870:0:17217:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790391584.074955:0:17217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eee400/0x2b1b7949f13e2265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e225e expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391584.074964:0:17217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52b5eee400/0x2b1b7949f13e2265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e225e expref: 21 pid: 17194 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391584.074972:0:17217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186500480:0@lo:104: 00000100:00100000:1.0:1790391584.074998:0:17217:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391584.075018:0:17217:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51810f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1790391584.075162:0:17186:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790391584.075180:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186500352 00000100:00100000:2.0:1790391584.075198:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186500352 00000100:00100000:2.0:1790391584.075273:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186500480 00000100:00100000:2.0:1790391584.075277:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186500480 00000100:00100000:2.0:1790391584.075292:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391584.075301:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+4:17217:x1877361186500352:12345-0@lo:104: 00010000:00010000:2.0:1790391584.075315:0:17186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075371:0:17186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790391584.075376:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+4:17217:x1877361186500352:12345-0@lo:104: Request processed in 77us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391584.075383:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391584.075400:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391584.075406:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b5c9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:17217:x1877361186500480:12345-0@lo:104: 00010000:00010000:2.0:1790391584.075413:0:17186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075456:0:17186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790391584.075462:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b5c9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:17217:x1877361186500480:12345-0@lo:104: Request processed in 57us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391584.075468:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790391584.075507:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391584.075513:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075520:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391584.075524:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075533:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391584.075540:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391584.075547:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391584.075576:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075583:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391584.075602:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075620:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eee000/0x2b1b7949f13e226c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2273 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075643:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391584.075646:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075652:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086e00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:2.0:1790391584.075654:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075661:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790391584.075668:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790391584.075673:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790391584.075687:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075693:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790391584.075700:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075705:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5183086e00/0x2b1b7949f13e225e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2265 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075717:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391584.075719:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391584.075721:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391584.075728:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391584.075754:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186500736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391584.075783:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391584.075811:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391584.075817:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186500608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391584.075841:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391584.075868:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186500736 00000100:00100000:2.0:1790391584.075873:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186500736 00010000:00010000:2.0:1790391584.075920:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eee400/0x2b1b7949f13e2265 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e225e expref: 22 pid: 17194 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391584.075941:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186500608 00000100:00100000:2.0:1790391584.075944:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186500608 00010000:00010000:2.0:1790391584.075955:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e2273 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e226c expref: 23 pid: 17197 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391584.075966:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391584.075972:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:3640:x1877361186500736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391584.075982:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391584.075988:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eee400/0x2b1b7949f13e2265 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e225e expref: 23 pid: 17194 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.075997:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eee400/0x2b1b7949f13e2265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e225e expref: 23 pid: 17194 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076013:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391584.076042:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:3640:x1877361186500736:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391584.076049:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790391584.076062:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391584.076067:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:3640:x1877361186500608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391584.076093:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391584.076098:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e2273 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e226c expref: 22 pid: 17197 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076106:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e2273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e226c expref: 22 pid: 17197 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076118:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076126:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790391584.076138:0:17189:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017236982s 00010000:00010000:2.0:1790391584.076143:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076149:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076157:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076163:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076168:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087a00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391584.076172:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076180:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076196:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076206:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391584.076229:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:3640:x1877361186500608:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391584.076235:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790391584.076293:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186500608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391584.076303:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186500736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391584.076333:0:17217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eef600/0x2b1b7949f13e2273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e226c expref: 21 pid: 17197 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391584.076343:0:17217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186500352:0@lo:104: 00010000:00010000:2.0:1790391584.076353:0:17217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eee400/0x2b1b7949f13e2265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e225e expref: 20 pid: 17194 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391584.076360:0:17217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186500480:0@lo:104: 00010000:00010000:2.0:1790391584.076375:0:17217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076383:0:17217:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076389:0:17217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391584.076395:0:17217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183087a00/0x2b1b7949f13e231b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391584.076730:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:18702:x1877361186500224:12345-0@lo:253:mount.lustre.0 Request processed in 8859us (12912us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391584.076739:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790391584.076824:0:18702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:18702:1877361186500224:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790391584.076834:0:18702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790391584.076837:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790391584.076839:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790391584.076840:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790391584.076841:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790391584.076842:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790391584.076843:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790391584.076845:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790391584.076847:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790391584.076848:0:18702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790391584.076858:0:18702:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1790391584.087333:0:18702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790391584.091500:0:18702:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790391584.091511:0:18702:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790391584.091545:0:18702:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790391584.091583:0:18702:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790391584.091623:0:18702:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790391584.091644:0:18702:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1790391584.107034:0:18702:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391584.107459:0:18702:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790391584.265311:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790391584.656805:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1790391585.059680:0:18781:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391585.060008:0:18781:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790391585.289547:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790391585.480333:0:17199:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790391585.480343:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5288361800 from 9 10000000:01000000:2.0:1790391585.480349:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790391585.480404:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391585.480418:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391585.480430:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391585.480475:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284946a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186500864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790391585.480547:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391585.480604:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5295722780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391585.480750:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186500864 00000100:00100000:3.0:1790391585.480758:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186500864 00000100:00100000:3.0:1790391585.480808:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790391585.480817:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+19:17199:x1877361186500864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391585.480830:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391585.480845:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b763dc00/0x2b1b7949f13e2329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2322 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391585.480868:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b763dc00/0x2b1b7949f13e2329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2322 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391585.480894:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b763dc00/0x2b1b7949f13e2329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2322 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391585.480903:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763dc00, rc 0) 00000100:00100000:3.0:1790391585.480951:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:17199:x1877361186500864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391585.480957:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790391585.481972:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284946a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186500864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391585.481993:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391585.482005:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391585.482090:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186500992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790391585.482141:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391585.482357:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391585.482381:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186500992 00000100:00100000:0.0:1790391585.482386:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186500992 00000100:00100000:0.0:1790391585.482425:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790391585.482433:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:17199:x1877361186500992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790391585.482451:0:17197:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790391585.482471:0:17197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790391585.482474:0:17197:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1790391585.482557:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:17199:x1877361186500992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391585.482564:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790391585.482612:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186500992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790391585.482671:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790391585.482679:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391585.482700:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790391585.482711:0:17199:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790391585.482713:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5284dc3000 from 9 10000000:01000000:0.0:1790391585.482715:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790391585.482741:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391585.482748:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391585.482757:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391585.482771:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186501120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391585.482803:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391585.482816:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391585.482828:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186501120 00000100:00100000:0.0:1790391585.482831:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186501120 00000100:00100000:0.0:1790391585.482854:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790391585.482859:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:17199:x1877361186501120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391585.482866:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391585.482903:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e2337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2330 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391585.482921:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e2337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2330 expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391585.482941:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e2337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2330 expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391585.482949:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b5eefa00, rc 0) 00000100:00100000:0.0:1790391585.482979:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:17199:x1877361186501120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391585.482984:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790391585.483015:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186501120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391585.483026:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391585.483036:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391585.483090:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186501248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790391585.483120:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391585.483140:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391585.483152:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186501248 00000100:00100000:0.0:1790391585.483155:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186501248 00000100:00100000:2.0:1790391585.483419:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790391585.483429:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:17199:x1877361186501248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790391585.483442:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790391585.483456:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790391585.483459:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1790391585.483526:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:17199:x1877361186501248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391585.483533:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790391585.485422:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186501248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790391585.485498:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790391585.485508:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391585.485519:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391586.312664:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391587.348825:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391587.848542:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391587.848587:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186501376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391587.848662:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391587.849025:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186501376 00000100:00100000:0.0:1790391587.849035:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186501376 00000100:00100000:0.0:1790391587.849369:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790391587.849380:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186501376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391587.849417:0:17207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391587.849478:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186501376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391587.849485:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391587.849593:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391587.849604:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186501504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391587.849639:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391587.849697:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186501376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391587.850538:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186501504 00000100:00100000:2.0:1790391587.850547:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186501504 00000100:00100000:2.0:1790391587.850597:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790391587.850605:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186501504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391587.850631:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790391587.850689:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186501504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391587.850695:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391587.850825:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186501504:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790391588.361109:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391589.384083:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391589.384244:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186501632:0@lo:400:kworker.0 00000100:00100000:2.0:1790391589.384324:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391589.384422:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186501632 00000100:00100000:3.0:1790391589.384449:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186501632 00000100:00100000:3.0:1790391589.384496:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790391589.384506:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:3639:x1877361186501632:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790391589.386491:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391589.386502:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391589.386505:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391589.386508:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391589.386584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391589.386588:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391589.386590:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391589.386593:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790391589.386697:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186501888:0@lo:400:kworker.0 00000100:00100000:0.0:1790391589.386760:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391589.386795:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186502400:0@lo:400:kworker.0 00000100:00100000:0.0:1790391589.386820:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391589.386840:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790391589.388119:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:3639:x1877361186501632:12345-0@lo:400:kworker.0 Request processed in 3606us (3787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391589.388133:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790391589.388800:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186502016:0@lo:400:kworker.0 00000100:00100000:0.0:1790391589.389416:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391589.389475:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186501888 00000100:00100000:0.0:1790391589.389482:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186501888 00000100:00100000:0.0:1790391589.389522:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186502400 00000100:00100000:0.0:1790391589.389525:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186502400 00000100:00100000:3.0:1790391589.389548:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186502016 00000100:00100000:0.0:1790391589.389549:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391589.389552:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186502016 00000100:00100000:0.0:1790391589.389568:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186501888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391589.389591:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790391589.389597:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186502016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391589.389623:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186501888:12345-0@lo:400:kworker.0 Request processed in 67us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391589.389627:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186502016:12345-0@lo:400:kworker.0 Request processed in 30us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391589.389630:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391589.389632:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790391589.389642:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391589.389648:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186502400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391589.389674:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186502400:12345-0@lo:400:kworker.0 Request processed in 26us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391589.389755:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1790391589.389793:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391589.389826:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186502016:0@lo:400:kworker.0 00010000:00080000:0.0:1790391589.389841:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5292339500 x1877361186501888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391589.389978:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186501888:0@lo:400:kworker.0 00010000:00080000:0.0:1790391589.389993:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e529233b100 x1877361186502400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391589.390001:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e529233b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186502400:0@lo:400:kworker.0 00000100:00100000:2.0:1790391589.390089:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186501632:0@lo:400:kworker.0 00000100:00100000:2.0:1790391589.390106:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186502144:0@lo:400:kworker.0 00000100:00100000:2.0:1790391589.390144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391589.390171:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790391589.390177:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186501760:0@lo:400:kworker.0 00000100:00100000:2.0:1790391589.390198:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391589.390221:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186502272:0@lo:400:kworker.0 00000100:00100000:2.0:1790391589.390242:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391589.390260:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186501760 00000100:00100000:3.0:1790391589.390265:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186501760 00000100:00100000:3.0:1790391589.390295:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790391589.390303:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186501760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391589.390308:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186502144 00000100:00100000:0.0:1790391589.390315:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186502144 00000100:00100000:3.0:1790391589.390338:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186501760:12345-0@lo:400:kworker.0 Request processed in 36us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391589.390344:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790391589.390760:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186502272 00000100:00100000:0.0:1790391589.390765:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186502272 00000100:00100000:0.0:1790391589.390791:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391589.390797:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186502144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391589.390831:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186502144:12345-0@lo:400:kworker.0 Request processed in 34us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391589.390838:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790391589.390976:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391589.390984:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186502272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391589.391012:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186502272:12345-0@lo:400:kworker.0 Request processed in 30us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391589.391018:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1790391589.391032:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391589.391105:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186501760:0@lo:400:kworker.0 00010000:00080000:2.0:1790391589.391116:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5292339f80 x1877361186502272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391589.391125:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186502272:0@lo:400:kworker.0 00010000:00080000:2.0:1790391589.391135:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5292339c00 x1877361186502144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391589.391142:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186502144:0@lo:400:kworker.0 00000040:00080000:2.0:1790391589.965467:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391590.410648:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790391590.696093:0:19071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790391591.435670:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790391591.738371:0:19123:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391591.739405:0:19123:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790391592.265736:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391577/real 1790391577] req@ffff9e52bf94ad80 x1877361186494976/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391592.265792:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e52bf94ad80 x1877361186494976/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391592.265802:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391577/real 1790391577] req@ffff9e52bf949180 x1877361186495104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391592.265812:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e52bf949180 x1877361186495104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790391592.265833:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528765e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391592.265859:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790391592.265863:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186494976:0@lo:8:kworker.0 00000100:00080000:1.0:1790391592.265868:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391592.265874:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790391592.265898:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186495104:0@lo:8:kworker.0 00000100:00080000:0.0:1790391592.266238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391592.266242:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391592.266245:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391592.266249:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790391592.266264:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391592.266267:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790391592.266270:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e528765e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391592.266276:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 490 00000100:00080000:0.0:1790391592.266282:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790391592.266289:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e528765e000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391592.266309:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf949180 x1877361186503040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391592.266329:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790391592.266332:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790391592.266333:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790391592.266336:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 490 00000100:00080000:0.0:1790391592.266339:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790391592.266344:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e51838d2800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391592.266356:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf94ad80 x1877361186503168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391592.266442:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186502912:0@lo:400:kworker.0 00000100:00100000:1.0:1790391592.266512:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391592.266567:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790391592.266574:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186502528:0@lo:400:kworker.0 00000100:00100000:1.0:1790391592.266605:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391592.266632:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186503296:0@lo:400:kworker.0 00000100:00100000:1.0:1790391592.266657:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391592.266687:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186502528 00000100:00100000:1.0:1790391592.266694:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186502528 00000100:00100000:1.0:1790391592.266739:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790391592.266747:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:3637:x1877361186502528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391592.266806:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:3637:x1877361186502528:12345-0@lo:400:kworker.0 Request processed in 59us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391592.266813:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790391592.266851:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186503296 00000100:00100000:1.0:1790391592.266854:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186503296 00000100:00100000:1.0:1790391592.266907:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391592.266914:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186503296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391592.266947:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186503296:12345-0@lo:400:kworker.0 Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391592.266953:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391592.266979:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186503040:0@lo:8:kworker.0 00000100:00100000:1.0:1790391592.267010:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391592.267030:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186503168:0@lo:8:kworker.0 00000100:00100000:1.0:1790391592.267050:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391592.267081:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186503040 00000100:00100000:1.0:1790391592.267085:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186503040 00000100:00100000:1.0:1790391592.267098:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186503168 00000100:00100000:1.0:1790391592.267100:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186503168 00000100:00100000:1.0:1790391592.267108:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391592.267113:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186503040:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790391592.267140:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:1.0:1790391592.267168:0:18707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e233e 00002000:00100000:1.0:1790391592.267182:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e5182dd9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1790391592.267186:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1790391592.267189:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790391592.267358:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1790391592.267389:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9e5182dde800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391592.267430:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1877361186503040:12345-0@lo:8:kworker.0 Request processed in 315us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391592.267436:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790391592.267451:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391592.267455:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186503168:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790391592.267466:0:18707:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790391592.269736:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186502912 00000100:00100000:2.0:1790391592.269745:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186502656:0@lo:400:kworker.0 00000100:00100000:0.0:1790391592.269750:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186502912 00000100:00100000:0.0:1790391592.269810:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391592.269818:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186502912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391592.269822:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391592.269852:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186503424:0@lo:400:kworker.0 00000100:00100000:0.0:1790391592.269871:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186502912:12345-0@lo:400:kworker.0 Request processed in 54us (3360us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391592.269895:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391592.269895:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790391592.269909:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186502656 00000100:00100000:0.0:1790391592.269913:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186502656 00000100:00100000:0.0:1790391592.269927:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391592.269929:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790391592.269932:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186502656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391592.269935:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186502784:0@lo:400:kworker.0 00000100:00100000:2.0:1790391592.269956:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391592.269960:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186502656:12345-0@lo:400:kworker.0 Request processed in 28us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391592.269966:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790391592.269974:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186503552:0@lo:400:kworker.0 00000100:00100000:2.0:1790391592.269994:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391592.270057:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186502656:0@lo:400:kworker.0 00000100:00100000:2.0:1790391592.270099:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186503424 00000100:00100000:2.0:1790391592.270102:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186503424 00000100:00100000:2.0:1790391592.270142:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186502784 00000100:00100000:2.0:1790391592.270145:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186502784 00000100:00100000:2.0:1790391592.270153:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186503552 00000100:00100000:2.0:1790391592.270155:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186503552 00000100:00100000:2.0:1790391592.270165:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790391592.270170:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186503424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391592.270201:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186503424:12345-0@lo:400:kworker.0 Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391592.270208:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790391592.270218:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790391592.270223:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186502784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391592.270244:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186502784:12345-0@lo:400:kworker.0 Request processed in 21us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391592.270249:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790391592.270258:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790391592.270262:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186503552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391592.270283:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186503552:12345-0@lo:400:kworker.0 Request processed in 21us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391592.270288:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1790391592.270300:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790391592.270304:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790391592.270341:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf94bb80 x1877361186502784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391592.270353:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186502784:0@lo:400:kworker.0 00010000:00080000:3.0:1790391592.270369:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5292339880 x1877361186503552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391592.270383:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186503552:0@lo:400:kworker.0 00010000:00080000:3.0:1790391592.270398:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5292339f80 x1877361186503424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391592.270406:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186503424:0@lo:400:kworker.0 00000100:00100000:0.0:1790391592.271588:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186502528:0@lo:400:kworker.0 00010000:00080000:0.0:1790391592.271606:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5292339c00 x1877361186503296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391592.271632:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186503296:0@lo:400:kworker.0 00000100:00100000:0.0:1790391592.271645:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186502912:0@lo:400:kworker.0 00010000:00080000:0.0:1790391592.271691:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e52bf949180 x1877361186503040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391592.271700:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391592.271708:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1790391592.271717:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790391592.271723:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790391592.271727:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e528765e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790391592.271738:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790391592.271743:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186503040:0@lo:8:kworker.0 00000004:00080000:2.0:1790391592.275967:0:17943:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1790391592.276000:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1877361186503808:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1790391592.276078:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391592.276125:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254f00 going to sleep for 11 seconds 00000004:00080000:2.0:1790391592.276146:0:17942:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790391592.276238:0:17942:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 505643360534ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790391592.276246:0:17942:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1790391592.276507:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186503680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391592.276553:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391592.276635:0:18708:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790391592.276643:0:18708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790391592.280182:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186503808 00000100:00100000:0.0:1790391592.280197:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186503808 00000100:00080000:3.0:1790391592.281292:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391592.285395:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186503680 00000100:00100000:0.0:1790391592.285422:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186503680 00000100:00100000:0.0:1790391592.285494:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391592.285506:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3637:x1877361186503680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391592.285557:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790391592.285650:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3637:x1877361186503680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (9096us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391592.285657:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790391592.285710:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5284947b80 x1877361186503680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391592.285750:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186503680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391592.288222:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790391592.288241:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17943:x1877361186503808:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1790391592.288729:0:17934:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1790391592.291065:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1877361186503168:12345-0@lo:8:kworker.0 Request processed in 23598us (24003us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790391592.291081:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1790391592.295449:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391592.295462:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790391592.295467:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186503168:0@lo:8:kworker.0 00002000:00080000:1.0:1790391592.301511:0:19144:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1790391592.301522:0:19144:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1790391592.301629:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17943:x1877361186503808:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13389us (25546us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391592.301642:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790391592.302265:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5284945c00 x1877361186503808/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790391608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391592.302280:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1877361186503808:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1790391592.302294:0:17943:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1790391592.302334:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5284945c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1877361186503936:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1790391592.302374:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391592.302508:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391592.307527:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186503936 00000100:00100000:1.0:1790391592.307556:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186503936 00000100:00100000:1.0:1790391592.307666:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790391592.307677:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17943:x1877361186503936:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790391592.307719:0:18708:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1790391592.307809:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17943:x1877361186503936:12345-0@lo:5:osp-pre-0-1.0 Request processed in 134us (5434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391592.307816:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790391592.307908:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5284945c00 x1877361186503936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391608 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391592.307924:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5284945c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1877361186503936:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1790391592.307938:0:17943:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1790391592.307985:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1877361186504064:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1790391592.308022:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391592.311304:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b9bdb600 going to sleep for 11 seconds 00000100:00100000:2.0:1790391592.311624:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186504064 00000100:00100000:2.0:1790391592.311635:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186504064 00000100:00100000:2.0:1790391592.311696:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391592.311707:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17943:x1877361186504064:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1790391592.311774:0:18709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:1.0:1790391592.350483:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1790391592.350517:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1790391592.352575:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17943:x1877361186504064:12345-0@lo:5:osp-pre-0-1.0 Request processed in 40861us (44544us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790391592.352589:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790391592.354692:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5183a41f80 x1877361186504064/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391608 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391592.354718:0:17943:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790391592.354727:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17943:1877361186504064:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1790391592.354744:0:17943:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1790391592.354802:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17943:1877361186504192:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790391592.354857:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391592.354912:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b9bdb600 going to sleep for 11 seconds 00000100:00100000:0.0:1790391592.355124:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186504192 00000100:00100000:0.0:1790391592.355132:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186504192 00000100:00100000:0.0:1790391592.355184:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391592.355195:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17943:x1877361186504192:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1790391592.355256:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17943:x1877361186504192:12345-0@lo:900:osp-pre-0-1.0 Request processed in 63us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391592.355264:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790391592.355973:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5183a41f80 x1877361186504192/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790391608 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391592.356008:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17943:1877361186504192:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1790391592.465919:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790391592.838517:0:19174:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391592.838753:0:19174:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790391592.968169:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186504320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391592.968249:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391592.968365:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186504320 00000100:00100000:1.0:1790391592.968374:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186504320 00000100:00100000:1.0:1790391592.968429:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790391592.968440:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186504320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391592.968475:0:17207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790391592.968543:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186504320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391592.968550:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790391592.968604:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186504320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391592.968935:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391592.968946:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186504448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391592.968989:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391592.969130:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186504448 00000100:00100000:1.0:1790391592.969136:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186504448 00000100:00100000:1.0:1790391592.969172:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790391592.969179:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186504448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391592.969200:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790391592.969241:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186504448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391592.969248:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790391592.969279:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186504448:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790391593.481096:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391594.505036:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790391594.900459:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391595.539359:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391596.552958:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391597.384810:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391577/real 1790391577] req@ffff9e52bf94a300 x1877361186494592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391597 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391597.384840:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e52bf94a300 x1877361186494592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391597 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391597.384849:0:3636:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790391577/real 1790391577] req@ffff9e52bf949c00 x1877361186494720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391597 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391597.384860:0:3636:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e52bf949c00 x1877361186494720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790391597 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790391597.384903:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183375000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790391597.384921:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790391597.384925:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186494592:0@lo:8:kworker.0 00000100:00080000:0.0:1790391597.384942:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790391597.384948:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790391597.384951:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186494720:0@lo:8:kworker.0 00000100:00080000:3.0:1790391597.385251:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391597.385255:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790391597.385257:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e5183375000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391597.385262:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:3.0:1790391597.385268:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790391597.385274:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e5183375000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391597.385295:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183a40a80 x1877361186504832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391597.385304:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391597.385306:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790391597.385308:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391597.385311:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:3.0:1790391597.385313:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790391597.385316:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5183835000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391597.385326:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183a42680 x1877361186504960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790391597.385352:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790391597.385356:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790391597.385358:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790391597.385361:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 505 00000100:00080000:3.0:1790391597.385363:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790391597.385367:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e51838d2800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:3.0:1790391597.385590:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183a40000 x1877361186505472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790391597.385788:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186504576:0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.385866:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391597.385943:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186505344:0@lo:400:kworker.0 00000100:00100000:0.0:1790391597.387163:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186504832:0@lo:8:kworker.0 00000100:00100000:0.0:1790391597.387221:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391597.387256:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186504960:0@lo:8:kworker.0 00000100:00100000:0.0:1790391597.387278:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391597.387295:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186505472:0@lo:8:kworker.0 00000100:00100000:0.0:1790391597.387316:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391597.387382:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186504832 00000100:00100000:0.0:1790391597.387391:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186504832 00000100:00100000:3.0:1790391597.387747:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391597.392353:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186505216:0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.392426:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391597.392454:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186505856:0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.392476:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391597.392534:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186504704:0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.392558:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391597.392585:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186505600:0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.392603:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391597.392620:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790391597.392625:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186505088:0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.392644:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391597.392658:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186505728:0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.392675:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391597.392706:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186504576 00000100:00100000:3.0:1790391597.392714:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186504576 00000100:00100000:3.0:1790391597.392766:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790391597.392775:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a0b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:3640:x1877361186504576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.392821:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a0b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:3640:x1877361186504576:12345-0@lo:400:kworker.0 Request processed in 46us (6955us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391597.392839:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790391597.392871:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186505856 00000100:00100000:3.0:1790391597.392890:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186505856 00000100:00100000:3.0:1790391597.392917:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186505600 00000100:00100000:3.0:1790391597.392919:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186505600 00000100:00100000:3.0:1790391597.392946:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186505088 00000100:00100000:3.0:1790391597.392949:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186505088 00000100:00100000:3.0:1790391597.392972:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186505728 00000100:00100000:3.0:1790391597.392975:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186505728 00000100:00100000:3.0:1790391597.392991:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391597.392996:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186505856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.393035:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877361186505856:12345-0@lo:400:kworker.0 Request processed in 37us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391597.393041:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391597.393052:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391597.393058:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186505600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.393285:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186505600:12345-0@lo:400:kworker.0 Request processed in 226us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391597.393292:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391597.393305:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790391597.393310:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186505088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.393336:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186505088:12345-0@lo:400:kworker.0 Request processed in 26us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391597.393341:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790391597.393352:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790391597.393357:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186505728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.393393:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186505728:12345-0@lo:400:kworker.0 Request processed in 35us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391597.393398:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1790391597.393493:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391597.393497:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790391597.393526:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831dc000 x1877361186505856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391597.393541:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1877361186505856:0@lo:400:kworker.0 00010000:00080000:3.0:1790391597.393574:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5183a41880 x1877361186505088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391597.393583:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186505088:0@lo:400:kworker.0 00010000:00080000:3.0:1790391597.393594:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831de300 x1877361186505728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391597.393602:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186505728:0@lo:400:kworker.0 00010000:00080000:3.0:1790391597.393611:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e51831dd880 x1877361186505600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391597.393619:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186505600:0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.393649:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186504576:0@lo:400:kworker.0 00000100:00100000:2.0:1790391597.394273:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186505216 00000100:00100000:2.0:1790391597.394281:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186505216 00000100:00100000:2.0:1790391597.394316:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186504704 00000100:00100000:2.0:1790391597.394320:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186504704 00000100:00100000:2.0:1790391597.394336:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790391597.394343:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186505216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391597.394401:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186505216:12345-0@lo:400:kworker.0 Request processed in 58us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391597.394407:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790391597.394433:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790391597.394440:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186504704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391597.394474:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186504704:12345-0@lo:400:kworker.0 Request processed in 35us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391597.394480:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391597.394630:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186505216:0@lo:400:kworker.0 00000100:00100000:3.0:1790391597.394658:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186504704:0@lo:400:kworker.0 00000100:00100000:0.0:1790391597.396614:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186504960 00000100:00100000:0.0:1790391597.396630:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186504960 00000100:00100000:0.0:1790391597.396661:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186505472 00000100:00100000:0.0:1790391597.396665:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186505472 00000100:00100000:0.0:1790391597.396674:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186505344 00000100:00100000:0.0:1790391597.396677:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186505344 00000100:00080000:0.0:1790391597.396705:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391597.396731:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790391597.396741:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186505344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391597.396851:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186505344:12345-0@lo:400:kworker.0 Request processed in 111us (9103us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391597.396858:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790391597.396921:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5183a42a00 x1877361186505344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790391613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391597.396937:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186505344:0@lo:400:kworker.0 00000100:00100000:0.0:1790391597.398108:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790391597.398118:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186504832:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790391597.398151:0:18708:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1790391597.398180:0:18708:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e2345 00002000:00100000:0.0:1790391597.398196:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e52b5fb7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790391597.398200:0:18708:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1790391597.398203:0:18708:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790391597.398276:0:18708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790391597.398302:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9e52b5fb3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790391597.398371:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1877361186504832:12345-0@lo:8:kworker.0 Request processed in 251us (11148us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391597.398378:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790391597.398547:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5183a40a80 x1877361186504832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391597.398558:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790391597.398566:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790391597.398574:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790391597.398579:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790391597.398581:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183375000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790391597.398595:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790391597.398600:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186504832:0@lo:8:kworker.0 00000004:00080000:0.0:1790391597.398654:0:17226:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1790391597.398675:0:17226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17226:1877361186506112:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790391597.398710:0:17226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391597.398728:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183075300 going to sleep for 11 seconds 00000004:00080000:0.0:1790391597.398752:0:17225:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790391597.398814:0:17225:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 510765936300ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790391597.398821:0:17225:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1790391597.398845:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5292338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186505984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391597.400057:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391597.400278:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186505984 00000100:00100000:0.0:1790391597.400286:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186505984 00000100:00100000:0.0:1790391597.400335:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790391597.400343:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186505984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391597.400369:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790391597.400720:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186505984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 377us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391597.400729:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790391597.400750:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790391597.400784:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e5292338700 x1877361186505984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391597.400803:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186505984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391597.402133:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186506112 00000100:00100000:0.0:1790391597.402149:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186506112 00000100:00100000:0.0:1790391597.402195:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790391597.402204:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e529233b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186504960:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790391597.402233:0:18708:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790391597.402597:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391597.402603:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1877361186505472:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790391597.402614:0:19144:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790391597.402705:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1877361186505472:12345-0@lo:8:kworker.0 Request processed in 100us (15387us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790391597.402713:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391597.402729:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391597.402737:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17226:x1877361186506112:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1790391597.406041:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391597.406056:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790391597.406060:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186505472:0@lo:8:kworker.0 00002000:00080000:1.0:1790391597.433956:0:19144:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1790391597.434037:0:19144:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1790391597.434043:0:19144:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1790391597.439737:0:17182:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1790391597.440667:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e529233b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186504960:12345-0@lo:8:kworker.0 Request processed in 38456us (53379us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790391597.440681:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1790391597.440739:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790391597.440744:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790391597.440764:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186504960:0@lo:8:kworker.0 00002000:00010000:0.0:1790391597.457801:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.457815:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b56712/0x2b1b7949f13e234c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.457835:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.457840:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.457846:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b56712/0x2b1b7949f13e234c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.457867:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b56712/0x2b1b7949f13e234c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.457903:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b56712/0x2b1b7949f13e234c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.457911:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b56712/0x2b1b7949f13e234c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.457932:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391597.458375:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391597.458391:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b56712/0x2b1b7949f13e234c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.458400:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eeec00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391597.458406:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b56712/0x2b1b7949f13e234c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.458416:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b56712/0x2b1b7949f13e234c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.458436:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b56712/0x2b1b7949f13e234c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.458444:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b56712/0x2b1b7949f13e234c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.458467:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391597.458470:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391597.458472:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.458578:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.458584:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e2353 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.458592:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.458596:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.458599:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e2353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.458617:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e2353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.458625:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e2353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.458632:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e2353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.458648:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391597.458656:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391597.458660:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e2353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.458667:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391597.458671:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e2353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.458679:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e2353 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.458690:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e2353 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.458697:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078793e21/0x2b1b7949f13e2353 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.458718:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391597.458720:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391597.458721:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.459132:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.459138:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc441bd/0x2b1b7949f13e235a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459147:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.459151:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.459155:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cc441bd/0x2b1b7949f13e235a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459164:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cc441bd/0x2b1b7949f13e235a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459171:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc441bd/0x2b1b7949f13e235a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459178:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cc441bd/0x2b1b7949f13e235a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459201:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391597.459452:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391597.459457:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cc441bd/0x2b1b7949f13e235a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.459466:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391597.459470:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc441bd/0x2b1b7949f13e235a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.459500:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc441bd/0x2b1b7949f13e235a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.459513:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cc441bd/0x2b1b7949f13e235a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.459521:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cc441bd/0x2b1b7949f13e235a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.459537:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391597.459539:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391597.459540:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.459619:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.459625:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2361 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459643:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.459646:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.459650:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459659:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459666:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459674:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459688:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391597.459695:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391597.459700:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459706:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391597.459710:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459717:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459739:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2361 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459745:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2361 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.459759:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391597.459760:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391597.459762:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.460177:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.460185:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069628fb7/0x2b1b7949f13e2368 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.460194:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.460197:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.460202:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069628fb7/0x2b1b7949f13e2368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.460212:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069628fb7/0x2b1b7949f13e2368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.460221:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069628fb7/0x2b1b7949f13e2368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.460229:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069628fb7/0x2b1b7949f13e2368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.460382:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391597.460688:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.460694:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081abdf2c/0x2b1b7949f13e236f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.460702:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.460706:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.460709:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081abdf2c/0x2b1b7949f13e236f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.460718:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081abdf2c/0x2b1b7949f13e236f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.460727:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081abdf2c/0x2b1b7949f13e236f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.460734:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081abdf2c/0x2b1b7949f13e236f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.461927:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391597.461944:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069628fb7/0x2b1b7949f13e2368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.461957:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391597.461974:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069628fb7/0x2b1b7949f13e2368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.461986:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069628fb7/0x2b1b7949f13e2368 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.462004:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069628fb7/0x2b1b7949f13e2368 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.462022:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069628fb7/0x2b1b7949f13e2368 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.462040:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391597.462044:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081abdf2c/0x2b1b7949f13e236f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.462049:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391597.462052:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081abdf2c/0x2b1b7949f13e236f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.462060:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081abdf2c/0x2b1b7949f13e236f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.462082:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081abdf2c/0x2b1b7949f13e236f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391597.462089:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391597.462091:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391597.462093:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391597.462643:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790391597.462651:0:19144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081abdf2c/0x2b1b7949f13e236f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391597.463265:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.463273:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e936366b/0x2b1b7949f13e2376 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.463292:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.463296:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.463303:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e936366b/0x2b1b7949f13e2376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.463315:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e936366b/0x2b1b7949f13e2376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.463324:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e936366b/0x2b1b7949f13e2376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.463331:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e936366b/0x2b1b7949f13e2376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.463351:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391597.463658:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.463664:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e237d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.463673:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.463677:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.463681:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e237d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.463691:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e237d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.463711:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e237d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.463718:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e237d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.463727:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790391597.464138:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.464146:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2384 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.464155:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.464159:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.464163:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2384 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.464173:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2384 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.464182:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2384 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.464189:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.464209:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1790391597.464455:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.464462:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e238b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.464470:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.464474:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.464478:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e238b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.464498:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e238b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.464506:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e238b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.464513:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e238b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.464521:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1790391597.466213:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.466228:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2392 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.466244:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.466255:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.466261:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.466274:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.466283:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.466291:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.466302:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1790391597.466695:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790391597.466705:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e936366b/0x2b1b7949f13e2376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466712:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391597.466717:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e936366b/0x2b1b7949f13e2376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466727:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e936366b/0x2b1b7949f13e2376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466747:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e936366b/0x2b1b7949f13e2376 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466754:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e936366b/0x2b1b7949f13e2376 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466775:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790391597.466785:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e237d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466791:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391597.466794:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e237d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466801:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e237d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466810:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e237d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466817:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e237d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466829:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790391597.466833:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466839:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391597.466843:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466850:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2384 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466872:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2384 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466895:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e2384 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466908:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391597.466911:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e238b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466918:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391597.466920:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e238b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466927:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e238b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466935:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e238b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466942:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e238b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.466952:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391597.466955:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.467132:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391597.467136:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.467143:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2392 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.467153:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2392 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.467159:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e2392 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.467173:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391597.467175:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391597.467177:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.467288:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.467295:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2399 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.467305:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.467308:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.467312:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.467322:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.467331:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.467344:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.468056:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391597.470396:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.470412:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.470432:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.470436:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.470442:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.470456:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.470466:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.470474:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.470568:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391597.470577:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.470585:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391597.470590:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.470600:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2399 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.470633:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2399 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.470641:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2399 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.475281:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391597.475299:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.475315:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144c00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.475321:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.475344:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.475366:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.475374:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.475376:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.475378:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.475385:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.475387:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.475390:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391597.477355:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790391597.477372:0:19144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391597.478167:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.478176:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013a64525/0x2b1b7949f13e23a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.478191:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.478196:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.478203:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013a64525/0x2b1b7949f13e23a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.478220:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013a64525/0x2b1b7949f13e23a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.478229:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013a64525/0x2b1b7949f13e23a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.478237:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013a64525/0x2b1b7949f13e23a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.478268:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391597.478589:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391597.478597:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013a64525/0x2b1b7949f13e23a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.478606:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391597.478610:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013a64525/0x2b1b7949f13e23a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.478619:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013a64525/0x2b1b7949f13e23a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.478636:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013a64525/0x2b1b7949f13e23a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.478643:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013a64525/0x2b1b7949f13e23a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391597.478661:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391597.478663:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391597.478672:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.478796:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.479152:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.479160:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e23ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.479171:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.479175:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.479187:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e23ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.479199:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e23ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.479208:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e23ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.479216:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e23ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.479239:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391597.479606:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391597.479613:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e23ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.479621:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.479625:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e23ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.479634:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e23ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.479647:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e23ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.479667:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e23ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.479687:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.479688:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.479690:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.479777:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.479783:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8981cf3/0x2b1b7949f13e23b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.479792:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.479795:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.479799:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8981cf3/0x2b1b7949f13e23b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.479809:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8981cf3/0x2b1b7949f13e23b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.479818:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8981cf3/0x2b1b7949f13e23b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.479835:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8981cf3/0x2b1b7949f13e23b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.479856:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391597.480246:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.480254:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e23bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.480263:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.480266:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.480271:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e23bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.480280:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e23bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.480288:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e23bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.480295:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e23bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.480308:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790391597.480628:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.480634:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5427670/0x2b1b7949f13e23c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.480648:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.480651:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.480655:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5427670/0x2b1b7949f13e23c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.480665:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5427670/0x2b1b7949f13e23c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.480673:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5427670/0x2b1b7949f13e23c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.480681:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5427670/0x2b1b7949f13e23c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.480690:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1790391597.480942:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790391597.480952:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8981cf3/0x2b1b7949f13e23b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.480970:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.480976:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8981cf3/0x2b1b7949f13e23b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.480986:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8981cf3/0x2b1b7949f13e23b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481000:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8981cf3/0x2b1b7949f13e23b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481008:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8981cf3/0x2b1b7949f13e23b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481028:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391597.481031:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e23bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481045:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.481048:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e23bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481056:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e23bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481078:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e23bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481084:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085e640e3/0x2b1b7949f13e23bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481097:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391597.481101:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5427670/0x2b1b7949f13e23c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481107:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.481110:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5427670/0x2b1b7949f13e23c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481116:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5427670/0x2b1b7949f13e23c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481124:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5427670/0x2b1b7949f13e23c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481137:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5427670/0x2b1b7949f13e23c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.481150:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.481151:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.481153:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.481159:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.481560:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.481566:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d248686e/0x2b1b7949f13e23ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.481576:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.481580:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.481584:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d248686e/0x2b1b7949f13e23ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.481594:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d248686e/0x2b1b7949f13e23ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.481614:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d248686e/0x2b1b7949f13e23ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.481622:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d248686e/0x2b1b7949f13e23ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.481643:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391597.482525:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.482534:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e23d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.482544:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.482548:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.482552:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e23d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.482562:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e23d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.482570:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e23d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.482577:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e23d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.482601:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790391597.482900:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391597.482908:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d248686e/0x2b1b7949f13e23ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.482916:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145a00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.482921:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d248686e/0x2b1b7949f13e23ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.482930:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d248686e/0x2b1b7949f13e23ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.482944:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d248686e/0x2b1b7949f13e23ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.482951:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d248686e/0x2b1b7949f13e23ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.483044:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391597.483048:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e23d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.483120:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145c00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.483125:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e23d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.483134:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e23d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.483145:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e23d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.483152:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ef2ca91/0x2b1b7949f13e23d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.483167:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.483169:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.483170:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.483177:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.483597:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.483605:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa545fa5/0x2b1b7949f13e23d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.483617:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.483621:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.483626:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa545fa5/0x2b1b7949f13e23d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.483638:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa545fa5/0x2b1b7949f13e23d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.483647:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa545fa5/0x2b1b7949f13e23d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.483655:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa545fa5/0x2b1b7949f13e23d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.483681:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391597.484552:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391597.484561:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa545fa5/0x2b1b7949f13e23d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.484570:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144a00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.484574:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa545fa5/0x2b1b7949f13e23d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.484584:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa545fa5/0x2b1b7949f13e23d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.484607:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa545fa5/0x2b1b7949f13e23d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.484615:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa545fa5/0x2b1b7949f13e23d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.484633:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.484635:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.484637:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.484757:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.484763:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e23df lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.484773:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.484783:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.484790:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e23df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.484801:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e23df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.484810:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e23df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.484818:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e23df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.485030:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391597.485594:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.485602:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e23e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.485612:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.485615:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.485620:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e23e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.485631:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e23e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.485638:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e23e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.485653:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e23e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.485775:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391597.485782:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e23df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.485789:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.485793:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e23df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.485801:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e23df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.485814:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e23df lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.485821:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053410c85/0x2b1b7949f13e23df lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.485848:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391597.485852:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e23e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.485858:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.485861:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e23e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.485868:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e23e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.487137:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e23e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.487157:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.487159:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.487161:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391597.487376:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790391597.487383:0:19144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d053a9f/0x2b1b7949f13e23e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790391597.488114:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.488123:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e23ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.488136:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.488141:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.488147:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e23ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.488162:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e23ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.488171:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e23ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.488179:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e23ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.488207:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790391597.488539:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.488545:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e23f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.488554:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.488557:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.488561:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e23f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.488570:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e23f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.488578:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e23f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.488584:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e23f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.488592:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790391597.489054:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391597.489265:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391597.489274:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e23ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.489284:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.489289:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e23ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.489311:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e23ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.489328:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e23ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.489336:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f98c48e/0x2b1b7949f13e23ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.489359:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391597.489362:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e23f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.489368:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.489370:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e23f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.489376:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e23f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.489385:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e23f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.489392:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d31561/0x2b1b7949f13e23f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.489496:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.489509:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.489519:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.489522:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.489533:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.489541:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.489549:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.489559:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391597.490282:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391597.490290:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.490300:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144c00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.490304:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.490314:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.490328:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.490336:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098169a9f/0x2b1b7949f13e23fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.490351:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.490353:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.490355:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.490365:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790391597.490568:0:19144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391597.490574:0:19144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2402 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.490584:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790391597.490588:0:19144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391597.490592:0:19144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.490603:0:19144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.490612:0:19144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.490629:0:19144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391597.490689:0:19144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1790391597.490744:0:19144:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1790391597.490857:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5292339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17226:x1877361186506112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 88118us (92142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391597.490868:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790391597.492598:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5292339f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17226:1877361186506112:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790391597.492623:0:17226:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1790391597.492682:0:17226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17226:1877361186506240:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790391597.492741:0:17226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391597.492790:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b9bdb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391597.495208:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186506240 00000100:00100000:0.0:1790391597.495228:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186506240 00000100:00100000:0.0:1790391597.495298:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391597.495308:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17226:x1877361186506240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1790391597.495358:0:18709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:2.0:1790391597.509811:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391597.509828:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.509845:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391597.509861:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.509892:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2402 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.509916:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2402 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.509924:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd2a8219/0x2b1b7949f13e2402 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391597.509945:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.509946:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391597.509948:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790391597.519287:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1790391597.519341:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790391597.525414:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17226:x1877361186506240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 30094us (32659us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790391597.525427:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790391597.527048:0:17226:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1790391597.527075:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17226:1877361186506240:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790391597.527094:0:17226:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:1.0:1790391597.576076:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186506368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391597.576147:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391597.576230:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186506368 00000100:00100000:0.0:1790391597.576238:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186506368 00000100:00100000:0.0:1790391597.576294:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391597.576303:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186506368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391597.576327:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790391597.576379:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186506368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391597.576385:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391597.576434:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186506368:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790391597.580246:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391598.088280:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790391598.088309:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186506496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391598.088391:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391598.090282:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186506496 00000100:00100000:1.0:1790391598.090301:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186506496 00000100:00100000:1.0:1790391598.090376:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790391598.090387:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186506496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391598.090435:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790391598.090556:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186506496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391598.090563:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391598.090771:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186506496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391598.096190:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790391598.096215:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186506624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391598.096285:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391598.096347:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186506624 00000100:00100000:2.0:1790391598.096355:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186506624 00000100:00100000:2.0:1790391598.096403:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790391598.096412:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186506624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391598.096447:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790391598.096508:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186506624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391598.096515:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790391598.096561:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186506624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790391598.600140:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391599.180641:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790391599.632298:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790391600.349558:0:19519:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790391600.349564:0:19519:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1790391600.349570:0:19519:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1790391600.350133:0:19519:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e52b5fb1000 00000020:01000004:0.0:1790391600.350149:0:19519:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790391600.350163:0:19519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790391600.350177:0:19519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e5182df19c0) 00000020:00000080:0.0:1790391600.350195:0:19519:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790391600.467222:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1790391600.476266:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1790391600.477075:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1790391600.477338:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1790391600.477611:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1790391600.481860:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1790391600.482577:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1790391600.488479:0:19519:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790391600.489549:0:19519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1790391600.489567:0:19519:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790391600.489583:0:19519:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2b1b7949f13e2410 00000020:01000004:1.0:1790391600.489591:0:19519:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1790391600.489617:0:19519:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.128@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790391600.489622:0:19519:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790391600.489628:0:19519:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1790391600.489688:0:19519:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1790391600.489694:0:19519:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.128@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1790391600.512305:0:19519:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.128@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790391600.512351:0:19519:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.128@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1790391600.512355:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790391600.512357:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790391600.512358:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391600.512365:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391600.512366:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391600.512368:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391600.512369:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391600.512370:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391600.512371:0:19519:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790391600.512375:0:19519:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1790391600.512377:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790391600.512379:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790391600.512379:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391600.512380:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391600.512381:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391600.512382:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391600.512383:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391600.512384:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391600.512385:0:19519:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790391600.512421:0:19519:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790391600.512443:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186506752:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790391600.512530:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391600.512588:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391600.515963:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186506752 00000100:00100000:2.0:1790391600.515983:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186506752 00000100:00100000:3.0:1790391600.516081:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790391600.516094:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:19519:x1877361186506752:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790391600.516130:0:17196:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790391600.516134:0:17196:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1790391600.516138:0:17196:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790391600.516618:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:19519:x1877361186506752:12345-0@lo:253:mount.lustre.0 Request processed in 526us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391600.516627:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790391600.516781:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186506752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790391600.516796:0:19519:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790391600.516798:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790391600.516800:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790391600.516801:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790391600.516802:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790391600.516804:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790391600.516805:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790391600.516807:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790391600.516809:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790391600.516810:0:19519:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790391600.516834:0:19519:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e52b5fb1000 from lustre-OST0001 10000000:01000000:1.0:1790391600.516863:0:19519:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1790391600.516866:0:19519:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790391600.516907:0:19519:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e52b5cacd40 local copy 00010000:00010000:1.0:1790391600.516917:0:19519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391600.517026:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186506880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790391600.517071:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391600.517109:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790391600.517302:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186506880 00000100:00100000:2.0:1790391600.517307:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186506880 00000100:00100000:2.0:1790391600.517343:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790391600.517352:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:19519:x1877361186506880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391600.517530:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:19519:x1877361186506880:12345-0@lo:501:mount.lustre.0 Request processed in 180us (458us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790391600.517539:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790391600.518870:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186506880:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790391600.518914:0:19519:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790391600.518951:0:19519:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790391600.518960:0:19519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.518970:0:19519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183086400/0x2b1b7949f13e2066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e206d expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391600.519002:0:19519:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e52b5fb1000 10000000:01000000:1.0:1790391600.519008:0:19519:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790391600.519014:0:19519:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790391600.519017:0:19519:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790391600.519021:0:19519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790391600.519025:0:19519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790391600.519169:0:19519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.519178:0:19519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.519189:0:19519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391600.519227:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790391600.519277:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391600.519317:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790391600.519378:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186507008 00000100:00100000:3.0:1790391600.519384:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186507008 00000100:00100000:3.0:1790391600.519424:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790391600.519433:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:19519:x1877361186507008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790391600.519443:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391600.519464:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b763c400/0x2b1b7949f13e241e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2417 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391600.519486:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b763c400/0x2b1b7949f13e241e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2417 expref: 22 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391600.519497:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b763c400/0x2b1b7949f13e241e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2417 expref: 22 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391600.519506:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763c400, rc 0) 00000100:00100000:3.0:1790391600.519544:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:19519:x1877361186507008:12345-0@lo:101:mount.lustre.0 Request processed in 111us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391600.519559:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790391600.519804:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391600.519816:0:19519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.519825:0:19519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391600.527626:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1790391600.531083:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391600.534553:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1790391600.534623:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1790391600.534651:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1790391600.536214:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1790391600.536266:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1790391600.536281:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1790391600.536310:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1790391600.536317:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1790391600.536441:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391600.536530:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.536693:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391600.542382:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186507136 00000100:00100000:2.0:1790391600.542402:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186507136 00000100:00100000:3.0:1790391600.542547:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790391600.542557:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:19519:x1877361186507136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790391600.542789:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:19519:x1877361186507136:12345-0@lo:501:mount.lustre.0 Request processed in 232us (6257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391600.542797:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790391600.542925:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391600.542985:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391600.543054:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.543100:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391600.543334:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186507264 00000100:00100000:3.0:1790391600.543340:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186507264 00000100:00100000:3.0:1790391600.543375:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790391600.543383:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:19519:x1877361186507264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391600.544270:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:19519:x1877361186507264:12345-0@lo:503:mount.lustre.0 Request processed in 884us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391600.544280:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790391600.545464:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507264:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790391600.546281:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391600.546386:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391600.546451:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.546571:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52b7470a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391600.551250:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186507392 00000100:00100000:1.0:1790391600.551272:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186507392 00000100:00100000:1.0:1790391600.551340:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790391600.551351:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:19519:x1877361186507392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391600.552527:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:19519:x1877361186507392:12345-0@lo:502:mount.lustre.0 Request processed in 1171us (6069us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.552539:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790391600.554236:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790391600.558471:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790391600.558515:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790391600.558530:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790391600.558543:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790391600.558558:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790391600.558570:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790391600.558582:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790391600.558596:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790391600.558610:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1790391600.559373:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391600.559482:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391600.559533:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391600.559605:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186507520 00000100:00100000:0.0:1790391600.559613:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186507520 00000100:00100000:0.0:1790391600.559685:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790391600.559696:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:19519:x1877361186507520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391600.559821:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:19519:x1877361186507520:12345-0@lo:502:mount.lustre.0 Request processed in 127us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391600.559830:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790391600.560263:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790391600.560343:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1790391600.560353:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1790391600.564108:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790391600.564124:0:19523:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1790391600.564131:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790391600.564134:0:19523:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790391600.564142:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790391600.564159:0:19523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e52ba40b380) 00000020:00000080:1.0:1790391600.564200:0:19523:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790391600.564207:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790391600.564286:0:19523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52b5fb1000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790391600.564295:0:19523:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790391600.564302:0:19523:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2b1b7949f13e242c 00010000:00010000:1.0:1790391600.581374:0:19523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1790391600.582101:0:19523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1790391600.589015:0:19523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1790391600.590544:0:19523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790391600.590554:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391600.590561:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391600.590563:0:19523:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790391600.590567:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391600.590571:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391600.590573:0:19523:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790391600.590575:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790391600.590577:0:19523:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790391600.590580:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391600.590583:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391600.590584:0:19523:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790391600.590586:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790391600.590589:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391600.590590:0:19523:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790391600.590593:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790391600.590626:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790391600.590629:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790391600.590631:0:19523:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790391600.590634:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1790391600.590869:0:19519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1790391600.590930:0:19519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790391600.590951:0:19519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.590964:0:19519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183087400/0x2b1b7949f13e2417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e241e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391600.590973:0:19519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b5fb1000 from 1 10000000:01000000:1.0:1790391600.590976:0:19519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790391600.591012:0:19519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.591021:0:19519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.591031:0:19519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391600.591068:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790391600.591138:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391600.591176:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186507648 00000100:00100000:1.0:1790391600.591183:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186507648 00000100:00100000:1.0:1790391600.591224:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790391600.591245:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:19519:x1877361186507648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391600.591258:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391600.591270:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5183087200/0x2b1b7949f13e243a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2433 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.591307:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183087200/0x2b1b7949f13e243a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2433 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.591319:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5183087200/0x2b1b7949f13e243a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2433 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.591327:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087200, rc 0) 00000100:00100000:1.0:1790391600.591359:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:19519:x1877361186507648:12345-0@lo:101:mount.lustre.0 Request processed in 116us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.591365:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790391600.591403:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790391600.591424:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391600.591438:0:19519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.591447:0:19519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790391600.594368:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790391600.595725:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790391600.596009:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1790391600.605139:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1790391600.605221:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1790391600.605230:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1790391600.605342:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391600.605410:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.605506:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aea80 going to sleep for 11 seconds 00000100:00100000:0.0:1790391600.611222:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186507776 00000100:00100000:0.0:1790391600.611241:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186507776 00000100:00100000:0.0:1790391600.611349:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790391600.611360:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:19519:x1877361186507776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391600.611576:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:19519:x1877361186507776:12345-0@lo:501:mount.lustre.0 Request processed in 218us (6164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391600.611584:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790391600.611701:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790391600.611757:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790391600.611823:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.614350:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aea80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391600.614499:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186507904 00000100:00100000:1.0:1790391600.614509:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186507904 00000100:00100000:1.0:1790391600.614565:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790391600.614592:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:19519:x1877361186507904:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790391600.614993:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:19519:x1877361186507904:12345-0@lo:503:mount.lustre.0 Request processed in 402us (3169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.615002:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790391600.615385:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186507904:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790391600.616118:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790391600.616203:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391600.616396:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.616437:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aea80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391600.616552:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186508032 00000100:00100000:1.0:1790391600.616559:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186508032 00000100:00100000:1.0:1790391600.616597:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790391600.616606:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:19519:x1877361186508032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391600.616951:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:19519:x1877361186508032:12345-0@lo:502:mount.lustre.0 Request processed in 345us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.616958:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790391600.617156:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391600.617563:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790391600.617593:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790391600.617610:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790391600.617624:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790391600.617651:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790391600.617681:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790391600.617699:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790391600.617714:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1790391600.617728:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790391600.617743:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1790391600.617758:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1790391600.617790:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790391600.617845:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.617914:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52967aea80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391600.618185:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186508160 00000100:00100000:1.0:1790391600.618192:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186508160 00000100:00100000:1.0:1790391600.618243:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790391600.618252:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:19519:x1877361186508160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790391600.618345:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:19519:x1877361186508160:12345-0@lo:502:mount.lustre.0 Request processed in 94us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.618353:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790391600.618581:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790391600.618628:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1790391600.618637:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790391600.619948:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391600.619960:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391600.619963:0:19527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790391600.619971:0:19527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52b5fb1000 00000020:00000080:0.0:1790391600.619975:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391600.619983:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391600.619985:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391600.619987:0:19527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790391600.619990:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391600.619992:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391600.619994:0:19527:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790391600.619997:0:19527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e52b5fb1000 00000020:00000080:0.0:1790391600.620000:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391600.620071:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391600.620075:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391600.620083:0:19527:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790391600.620087:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391600.620090:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391600.620092:0:19527:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391600.620095:0:19527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52b5fb1000 00000020:00000080:0.0:1790391600.620098:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391600.620118:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391600.620121:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391600.620122:0:19527:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790391600.620125:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790391600.620127:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391600.620129:0:19527:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790391600.620132:0:19527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e52b5fb1000 00000020:00000080:0.0:1790391600.620135:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790391600.620157:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790391600.620161:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790391600.620162:0:19527:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790391600.620166:0:19527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1790391600.620470:0:19519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790391600.620498:0:19519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790391600.620523:0:19519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.620535:0:19519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391600.620591:0:19519:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790391600.620599:0:19519:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e52b5fb1000 10000000:01000000:1.0:1790391600.620602:0:19519:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e52b5fb1000 10000000:01000000:1.0:1790391600.620606:0:19519:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790391600.620612:0:19519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e52b5fb1000 from 1 10000000:01000000:1.0:1790391600.620615:0:19519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790391600.620810:0:19519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.620821:0:19519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.620832:0:19519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391600.620856:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790391600.620941:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391600.620984:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186508288 00000100:00100000:1.0:1790391600.620992:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186508288 00000100:00100000:1.0:1790391600.621096:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391600.621108:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:19519:x1877361186508288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391600.621120:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391600.621134:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5183086c00/0x2b1b7949f13e2448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2441 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.621160:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183086c00/0x2b1b7949f13e2448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2441 expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.621171:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5183086c00/0x2b1b7949f13e2448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2441 expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.621191:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086c00, rc 0) 00000100:00100000:1.0:1790391600.621222:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508288:12345-0@lo:101:mount.lustre.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.621905:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790391600.621961:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391600.621991:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790391600.622010:0:19519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.622021:0:19519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391600.634872:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1790391600.635202:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391600.635400:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1790391600.635426:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1790391600.635441:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1790391600.635463:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1790391600.635481:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1790391600.635518:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1790391600.635535:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1790391600.635547:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1790391600.635558:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1790391600.635569:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1790391600.635581:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1790391600.635593:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1790391600.635608:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1790391600.635631:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1790391600.635656:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1790391600.635676:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1790391600.635689:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1790391600.635701:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1790391600.635711:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1790391600.635723:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1790391600.635734:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1790391600.635761:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1790391600.635776:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1790391600.635789:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1790391600.635803:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1790391600.635816:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1790391600.635828:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1790391600.635839:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1790391600.635852:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1790391600.635865:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1790391600.635906:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1790391600.635923:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1790391600.635937:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1790391600.635950:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1790391600.635963:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1790391600.635976:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1790391600.635988:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1790391600.636013:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1790391600.636029:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1790391600.636041:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1790391600.636053:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1790391600.636065:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1790391600.636077:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1790391600.636090:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1790391600.636104:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1790391600.636116:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1790391600.636144:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1790391600.636149:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1790391600.636237:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391600.636308:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.636363:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186508416 00000100:00100000:0.0:1790391600.636370:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186508416 00000100:00100000:0.0:1790391600.636417:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790391600.636427:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391600.636551:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508416:12345-0@lo:501:mount.lustre.0 Request processed in 126us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391600.636559:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790391600.636602:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903c49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391600.636623:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790391600.636655:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508544:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790391600.636690:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.636714:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903c49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391600.638820:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186508544 00000100:00100000:3.0:1790391600.638835:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186508544 00000100:00100000:3.0:1790391600.638907:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790391600.638916:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508544:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790391600.639069:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508544:12345-0@lo:503:mount.lustre.0 Request processed in 154us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391600.639077:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790391600.640486:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508544:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790391600.643257:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790391600.643361:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391600.643447:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.647865:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186508672 00000100:00100000:0.0:1790391600.647899:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186508672 00000100:00100000:0.0:1790391600.647950:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790391600.647959:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391600.648113:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508672:12345-0@lo:502:mount.lustre.0 Request processed in 154us (4666us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391600.648126:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790391600.648175:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903c49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391600.648196:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391600.648423:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1790391600.648466:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1790391600.648482:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1790391600.648497:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1790391600.648525:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1790391600.648540:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1790391600.648551:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1790391600.648563:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1790391600.648575:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1790391600.648588:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1790391600.648599:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1790391600.648610:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1790391600.648620:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1790391600.648630:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1790391600.648640:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1790391600.648650:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1790391600.648660:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1790391600.649128:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1790391600.649142:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1790391600.649153:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1790391600.649175:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1790391600.649188:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1790391600.649198:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1790391600.649209:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1790391600.649721:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1790391600.649754:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1790391600.649769:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1790391600.649792:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1790391600.649807:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1790391600.649820:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1790391600.649832:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1790391600.649844:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1790391600.649857:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1790391600.649870:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1790391600.649914:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1790391600.649930:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1790391600.649961:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1790391600.649977:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1790391600.649990:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1790391600.650003:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1790391600.650015:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1790391600.650026:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1790391600.650054:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1790391600.650069:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1790391600.650080:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1790391600.650093:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1790391600.650105:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1790391600.650116:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1790391600.650179:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391600.650775:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.650815:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903c49c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790391600.650918:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391600.650933:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186508800 00000100:00100000:3.0:1790391600.650940:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186508800 00000100:00100000:3.0:1790391600.650986:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790391600.650996:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391600.651128:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508800:12345-0@lo:502:mount.lustre.0 Request processed in 133us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391600.651136:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790391600.651759:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391600.651993:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1790391600.652021:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1790391600.652315:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790391600.652369:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.653351:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903c49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391600.660473:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186508928 00000100:00100000:3.0:1790391600.660491:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186508928 00000100:00100000:3.0:1790391600.660553:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790391600.660562:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790391600.661140:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186508928:12345-0@lo:502:mount.lustre.0 Request processed in 577us (8768us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391600.661150:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790391600.665184:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186508928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790391600.665371:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1790391600.665384:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790391600.674615:0:19532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790391600.674635:0:19532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e5290bf4d40) 00000020:00000080:2.0:1790391600.675341:0:19532:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1790391600.675425:0:19532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52b5fb1000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790391600.675430:0:19532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52b5fb1000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790391600.675432:0:19532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b5fb1000 3 00010000:00080000:2.0:1790391600.675475:0:19532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e52b5cb9800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.128@tcp at head 00010000:00010000:2.0:1790391600.681000:0:19532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1790391600.681495:0:19532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790391600.681550:0:19532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790391600.681569:0:19532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2b1b7949f13e2456 00000100:00080000:2.0:1790391600.681581:0:19532:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790391600.681587:0:19532:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e52b5cb9800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391600.681626:0:19532:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf94a300 x1877361186509056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391600.683146:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186509056:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391600.683220:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391600.684220:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186509056 00000100:00100000:3.0:1790391600.684246:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186509056 00000100:00100000:3.0:1790391600.684289:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391600.684297:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186509056:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790391600.684328:0:17202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1790391600.684363:0:17202:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2b1b7949f13e245d 00000004:00100000:3.0:1790391600.684388:0:17202:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790391600.684433:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9e51810c6000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1790391600.685209:0:19532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790391600.685295:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391600.685299:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790391600.685302:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391600.685307:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1790391600.685311:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790391600.685316:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5183835000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391600.685335:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf948380 x1877361186509440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790391600.686856:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186509440:0@lo:8:kworker.0 00000100:00100000:1.0:1790391600.686951:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.687051:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186509440 00000100:00100000:0.0:1790391600.687060:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186509440 00000100:00100000:0.0:1790391600.687094:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391600.687102:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186509440:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790391600.687158:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186509440:12345-0@lo:8:kworker.0 Request processed in 56us (206us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790391600.687164:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391600.687366:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1877361186509056:12345-0@lo:38:llog_process_th.0 Request processed in 3067us (4145us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391600.687375:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790391600.687737:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bf94a300 x1877361186509056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391600.687749:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391600.687758:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1790391600.687766:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790391600.687771:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790391600.687774:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e52b5cb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790391600.687781:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1877361186509056:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790391600.687821:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790391600.687826:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790391600.687829:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790391600.687832:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186509440:0@lo:8:kworker.0 00000100:00100000:0.0:1790391600.687948:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186509312:0@lo:400:kworker.0 00000100:00100000:0.0:1790391600.687985:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.688020:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391600.688029:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186509184:0@lo:400:kworker.0 00000100:00100000:0.0:1790391600.688127:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391600.688746:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186509312 00000100:00100000:1.0:1790391600.688753:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186509312 00000100:00100000:1.0:1790391600.688843:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790391600.688853:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186509312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391600.688925:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186509312:12345-0@lo:400:kworker.0 Request processed in 74us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.688932:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790391600.689956:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391600.689961:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790391600.689965:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391600.689970:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1790391600.689980:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790391600.689986:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e51838d2800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391600.690009:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e52bf94a300 x1877361186509952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391600.690075:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186509568:0@lo:400:kworker.0 00000100:00100000:2.0:1790391600.690123:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.690152:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186510208:0@lo:400:kworker.0 00000100:00100000:2.0:1790391600.690172:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.690193:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391600.690198:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186510080:0@lo:400:kworker.0 00000100:00100000:2.0:1790391600.690218:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.690361:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186509184 00000100:00100000:2.0:1790391600.690367:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186509184 00000100:00100000:2.0:1790391600.690400:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790391600.690407:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186509184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391600.690478:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186509184:12345-0@lo:400:kworker.0 Request processed in 71us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391600.690485:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790391600.690520:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186509824:0@lo:400:kworker.0 00000100:00100000:2.0:1790391600.690544:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.690561:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790391600.690565:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186509696:0@lo:400:kworker.0 00000100:00100000:2.0:1790391600.690584:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.690598:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186510336:0@lo:400:kworker.0 00000100:00100000:2.0:1790391600.690615:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.690651:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186509568 00000100:00100000:2.0:1790391600.690655:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186509568 00000100:00100000:2.0:1790391600.690674:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186510208 00000100:00100000:2.0:1790391600.690676:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186510208 00000100:00100000:3.0:1790391600.690785:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186509952:0@lo:8:kworker.0 00000100:00100000:3.0:1790391600.690815:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391600.690888:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186509824 00000100:00100000:3.0:1790391600.690893:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186509824 00000100:00080000:0.0:1790391600.691418:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391600.691423:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391600.691468:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186509312:0@lo:400:kworker.0 00000020:01000004:0.0:1790391600.691582:0:19532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790391600.691597:0:19532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e5182df0000) 00000020:00000080:0.0:1790391600.691619:0:19532:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1790391600.691859:0:19532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e52b5fb1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790391600.691865:0:19532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e52b5fb1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790391600.691867:0:19532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e52b5fb1000 3 00000100:00100000:1.0:1790391600.691938:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186509696 00000100:00100000:1.0:1790391600.691944:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186509696 00000100:00100000:1.0:1790391600.691977:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391600.691986:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186509696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391600.692056:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186509696:12345-0@lo:400:kworker.0 Request processed in 71us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.692062:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391600.692081:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186510080 00000100:00100000:1.0:1790391600.692084:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186510080 00000100:00100000:1.0:1790391600.692099:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186510336 00000100:00100000:1.0:1790391600.692101:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186510336 00000100:00100000:1.0:1790391600.692127:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391600.692133:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186509568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391600.692167:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186509568:12345-0@lo:400:kworker.0 Request processed in 34us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.692173:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790391600.692196:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391600.692200:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186510080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391600.692349:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186510080:12345-0@lo:400:kworker.0 Request processed in 148us (2129us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.692356:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391600.692368:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391600.692374:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186510336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391600.692403:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186510336:12345-0@lo:400:kworker.0 Request processed in 29us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.692408:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391600.692440:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186509184:0@lo:400:kworker.0 00000100:00080000:0.0:1790391600.692516:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790391600.692541:0:19532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e51823ec800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.128@tcp at head 00000100:00100000:2.0:1790391600.692902:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790391600.692911:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186510208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391600.692946:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186510208:12345-0@lo:400:kworker.0 Request processed in 37us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391600.692951:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790391600.692987:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186509696:0@lo:400:kworker.0 00010000:00080000:2.0:1790391600.693003:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288345f80 x1877361186510336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391600.693013:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186510336:0@lo:400:kworker.0 00010000:00080000:2.0:1790391600.693107:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288344000 x1877361186510080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391600.693117:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186510080:0@lo:400:kworker.0 00010000:00080000:2.0:1790391600.693127:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bf94b800 x1877361186509568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391600.693134:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186509568:0@lo:400:kworker.0 00010000:00080000:2.0:1790391600.693144:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288346d80 x1877361186510208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391600.693151:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186510208:0@lo:400:kworker.0 00000100:00100000:2.0:1790391600.693188:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186509952 00000100:00100000:2.0:1790391600.693193:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186509952 00000100:00100000:2.0:1790391600.693716:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790391600.693725:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186509952:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790391600.693791:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186509952:12345-0@lo:8:kworker.0 Request processed in 66us (2974us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790391600.693797:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790391600.693834:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790391600.693841:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790391600.693845:0:3636:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790391600.693849:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186509952:0@lo:8:kworker.0 00000100:00100000:3.0:1790391600.697183:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391600.697198:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186509824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391600.697359:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186509824:12345-0@lo:400:kworker.0 Request processed in 164us (6813us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391600.697367:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790391600.697419:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186509824:0@lo:400:kworker.0 00010000:00010000:0.0:1790391600.701057:0:19532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1790391600.701917:0:19532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1790391600.701979:0:19532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790391600.701992:0:19532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2b1b7949f13e246b 00000100:00080000:0.0:1790391600.702003:0:19532:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790391600.702009:0:19532:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e51823ec800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:0.0:1790391600.702053:0:19532:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5183bbca80 x1877361186510464/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790391600.702075:0:19532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1790391600.702438:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1877361186510464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790391600.702523:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391600.702630:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186510464 00000100:00100000:1.0:1790391600.702648:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186510464 00000100:00100000:1.0:1790391600.702688:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391600.702695:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1877361186510464:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790391600.702722:0:17202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:1.0:1790391600.702755:0:17202:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2b1b7949f13e2472 00000004:00100000:1.0:1790391600.702771:0:17202:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790391600.702821:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9e518214b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391600.702873:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1877361186510464:12345-0@lo:38:llog_process_th.0 Request processed in 177us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.702901:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790391600.703053:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183bbca80 x1877361186510464/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790391610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391600.703064:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790391600.703072:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1790391600.703078:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790391600.703082:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790391600.703084:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51823ec800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790391600.703090:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1877361186510464:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790391600.703377:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1790391600.703444:0:19519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790391600.703482:0:19519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790391600.703498:0:19519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391600.703509:0:19519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5183087600/0x2b1b7949f13e2441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2448 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790391600.703557:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790391600.703560:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790391600.703561:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391600.703562:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391600.703563:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391600.703565:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391600.703566:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391600.703568:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391600.703569:0:19519:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790391600.703574:0:19519:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790391600.703576:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790391600.703577:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790391600.703578:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391600.703579:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391600.703580:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391600.703581:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391600.703582:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391600.703588:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391600.703589:0:19519:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790391600.703606:0:19519:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790391600.703620:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186510592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790391600.703728:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.703758:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903c4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790391600.703779:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186510592 00000100:00100000:0.0:1790391600.703783:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186510592 00000100:00100000:0.0:1790391600.703816:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790391600.703824:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186510592:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790391600.703845:0:17196:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790391600.703858:0:17196:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790391600.718183:0:17196:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790391600.718207:0:17196:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790391600.718539:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:19519:x1877361186510592:12345-0@lo:253:mount.lustre.0 Request processed in 14711us (14805us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.718565:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 20000000:01000000:0.0:1790391600.718651:0:17217:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790391600.718656:0:17217:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790391600.718677:0:17217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391600.718693:0:17217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b763dc00/0x2b1b7949f13e2329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2322 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391600.718700:0:17217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e2337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2330 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391600.718708:0:17217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391600.718745:0:17217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e2337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2330 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391600.718758:0:17217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e2337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2330 expref: 23 pid: 17197 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391600.718784:0:17217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186510720:0@lo:104: 00000100:00100000:0.0:1790391600.718822:0:17217:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790391600.718870:0:17217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b763dc00/0x2b1b7949f13e2329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2322 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391600.718906:0:17217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52b763dc00/0x2b1b7949f13e2329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2322 expref: 23 pid: 17194 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391600.718914:0:17217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186510848:0@lo:104: 00000100:00100000:0.0:1790391600.718936:0:17217:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391600.718954:0:17217:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52903c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391600.718987:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f157595d-6a80-4a0f-be35-35ee7e9fe29d:19519:1877361186510592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790391600.718998:0:19519:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790391600.719001:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790391600.719003:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790391600.719004:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790391600.719005:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790391600.719007:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790391600.719008:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790391600.719010:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790391600.719012:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790391600.719013:0:19519:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790391600.719027:0:19519:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790391600.719201:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186510720 00000100:00100000:1.0:1790391600.719208:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186510720 00000100:00100000:1.0:1790391600.719253:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186510848 00000100:00100000:1.0:1790391600.719256:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186510848 00000100:00100000:1.0:1790391600.719270:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391600.719279:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+4:17217:x1877361186510720:12345-0@lo:104: 00010000:00010000:1.0:1790391600.719294:0:17185:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719341:0:17185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790391600.719347:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+4:17217:x1877361186510720:12345-0@lo:104: Request processed in 69us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.719353:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790391600.719366:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790391600.719372:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:17217:x1877361186510848:12345-0@lo:104: 00010000:00010000:1.0:1790391600.719379:0:17185:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719412:0:17185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790391600.719417:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:17217:x1877361186510848:12345-0@lo:104: Request processed in 46us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391600.719423:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1790391600.719438:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391600.719444:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719463:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef000 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391600.719475:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719485:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391600.719492:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391600.719498:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391600.719526:0:17190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719532:0:17190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391600.719550:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719558:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef000/0x2b1b7949f13e2330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2337 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719570:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391600.719573:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719579:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055800 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:1.0:1790391600.719582:0:17190:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719589:0:17190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790391600.719604:0:17190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790391600.719609:0:17190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790391600.719623:0:17190:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719629:0:17190:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790391600.719665:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719673:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5184055800/0x2b1b7949f13e2322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e2329 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.719685:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391600.719687:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391600.719688:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391600.719697:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790391600.719708:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186510976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391600.719739:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391600.719954:0:17217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186510720:0@lo:104: 00000100:00100000:1.0:1790391600.719963:0:17217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17217:1877361186510848:0@lo:104: 00010000:00010000:1.0:1790391600.719977:0:17217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391600.720609:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186511104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790391600.720778:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186510976 00000100:00100000:2.0:1790391600.720783:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186510976 00010000:00010000:2.0:1790391600.720807:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e2337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2330 expref: 24 pid: 17197 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391600.720832:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391600.720840:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3639:x1877361186510976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391600.720861:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391600.720868:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e2337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2330 expref: 24 pid: 17197 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.720915:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e2337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2330 expref: 24 pid: 17197 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.720930:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b5eefa00/0x2b1b7949f13e2337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2330 expref: 24 pid: 17197 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.720942:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391600.720980:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:3639:x1877361186510976:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391600.720987:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790391600.721044:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186510976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391600.721207:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391600.721535:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186511104 00000100:00100000:2.0:1790391600.721541:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186511104 00010000:00010000:2.0:1790391600.721560:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b763dc00/0x2b1b7949f13e2329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2322 expref: 23 pid: 17194 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391600.721590:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790391600.721597:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:3637:x1877361186511104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391600.721606:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391600.721609:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b763dc00/0x2b1b7949f13e2329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2322 expref: 23 pid: 17194 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721618:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b763dc00/0x2b1b7949f13e2329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2322 expref: 23 pid: 17194 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721719:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b763dc00/0x2b1b7949f13e2329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2322 expref: 23 pid: 17194 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721731:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721740:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790391600.721755:0:17189:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017236982s 00010000:00010000:2.0:1790391600.721760:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721767:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721774:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721781:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721788:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391600.721792:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721801:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721821:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391600.721839:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391600.721906:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:3637:x1877361186511104:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391600.721914:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1790391600.721987:0:17217:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.722006:0:17217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391600.722013:0:17217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2479 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391600.722159:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186511104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391600.722784:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1790391600.724631:0:19519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790391600.730171:0:19519:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1790391600.730183:0:19519:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1790391600.730218:0:19519:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790391600.730322:0:19519:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.128@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790391600.730339:0:19519:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1790391600.730368:0:19519:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1790391600.731436:0:19519:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790391600.731783:0:19519:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1790391601.643360:0:19587:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790391601.644184:0:19587:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790391601.681080:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790391602.375970:0:17199:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790391602.375986:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5288361800 from 10 10000000:01000000:0.0:1790391602.376064:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790391602.376109:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391602.376121:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391602.376132:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391602.376158:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186511232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790391602.376227:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391602.376270:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528916e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391602.376404:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186511232 00000100:00100000:3.0:1790391602.376412:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186511232 00000100:00100000:3.0:1790391602.376476:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790391602.376488:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:17199:x1877361186511232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391602.376502:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391602.376517:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b763de00/0x2b1b7949f13e2487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2480 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.376539:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b763de00/0x2b1b7949f13e2487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2480 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.376556:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b763de00/0x2b1b7949f13e2487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2480 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.376566:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763de00, rc 0) 00000100:00100000:3.0:1790391602.376607:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:17199:x1877361186511232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391602.376614:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790391602.377832:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186511232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391602.377854:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391602.377866:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391602.377961:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186511360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790391602.378010:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391602.378044:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528916e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391602.379054:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186511360 00000100:00100000:3.0:1790391602.379066:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186511360 00000100:00100000:3.0:1790391602.379123:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790391602.379132:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:17199:x1877361186511360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790391602.379153:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790391602.379174:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790391602.379177:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1790391602.379287:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:17199:x1877361186511360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391602.379294:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790391602.379337:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186511360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790391602.379397:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391602.379406:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.379415:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5295144e00/0x2b1b7949f13e2480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2487 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391602.379425:0:17199:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790391602.379434:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e5284dc3000 from 10 10000000:01000000:3.0:1790391602.379448:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790391602.379479:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.379487:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.379495:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391602.379512:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186511488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391602.379543:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391602.379571:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518330acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391602.379584:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186511488 00000100:00100000:3.0:1790391602.379587:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186511488 00000100:00100000:3.0:1790391602.379613:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790391602.379619:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:17199:x1877361186511488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391602.379627:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391602.379640:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52b763d000/0x2b1b7949f13e2495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e248e expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.379658:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52b763d000/0x2b1b7949f13e2495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e248e expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.379668:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52b763d000/0x2b1b7949f13e2495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e248e expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.379675:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52b763d000, rc 0) 00000100:00100000:3.0:1790391602.379702:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:17199:x1877361186511488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391602.379713:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790391602.379746:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186511488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391602.379757:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.379766:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391602.379804:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186511616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790391602.379831:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391602.379843:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e518330acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391602.379853:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186511616 00000100:00100000:3.0:1790391602.379856:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186511616 00000100:00100000:3.0:1790391602.379927:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790391602.379935:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:17199:x1877361186511616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790391602.379946:0:17197:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790391602.379959:0:17197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790391602.379961:0:17197:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1790391602.380023:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:17199:x1877361186511616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391602.380030:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790391602.380058:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186511616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790391602.380095:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790391602.380100:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.380117:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52b763c200/0x2b1b7949f13e248e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2495 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391602.697251:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391602.700679:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186511744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391602.700750:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391602.700804:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186511872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391602.700828:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391602.700871:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186511744 00000100:00100000:2.0:1790391602.700896:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186511744 00000100:00100000:2.0:1790391602.700943:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186511872 00000100:00100000:2.0:1790391602.700946:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186511872 00000100:00100000:2.0:1790391602.700966:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391602.700975:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186511744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391602.701003:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790391602.702168:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186511744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1187us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391602.702180:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391602.702205:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391602.702215:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186511872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391602.702232:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790391602.702262:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186511872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391602.702268:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790391602.702294:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391602.702338:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186511872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790391602.702376:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186511744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790391603.213683:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790391603.213705:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186512000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391603.213770:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391603.213914:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186512000 00000100:00100000:0.0:1790391603.213922:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186512000 00000100:00100000:0.0:1790391603.213973:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790391603.213982:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186512000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790391603.214312:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391603.214360:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186512000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 379us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391603.214367:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790391603.214413:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186512000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391603.216256:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391603.218937:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186512128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391603.220927:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391603.223398:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186512128 00000100:00100000:2.0:1790391603.223415:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186512128 00000100:00100000:2.0:1790391603.223489:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790391603.223500:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186512128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391603.223538:0:17207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790391603.223616:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186512128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391603.223622:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790391603.223753:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186512128:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790391603.721096:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790391604.107455:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790391604.745476:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.768714:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790391605.771957:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391605.771975:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790391605.771979:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391605.771994:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e5183835000 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391605.772018:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5288346300 x1877361186512640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790391605.772052:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790391605.772055:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790391605.772057:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790391605.772062:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e51838d2800 using connection 192.168.202.128@tcp/0@lo 00000100:00100000:2.0:1790391605.772073:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e5288344e00 x1877361186513152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790391605.772143:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186512768:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.772224:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.772271:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186513408:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.772293:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.772315:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790391605.772321:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186512256:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.772348:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.773065:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186512896:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.773106:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.773130:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186513536:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.773150:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.773178:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186512384:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.773198:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.773215:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186513024:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.773237:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.773254:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186513664:0@lo:400:kworker.0 00000100:00100000:1.0:1790391605.773602:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186512768 00000100:00100000:1.0:1790391605.773611:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186512768 00000100:00100000:1.0:1790391605.773653:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186513408 00000100:00100000:1.0:1790391605.773657:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186513408 00000100:00100000:1.0:1790391605.773681:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186513536 00000100:00100000:1.0:1790391605.773683:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186513536 00000100:00100000:1.0:1790391605.773699:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391605.773706:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186512768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391605.773763:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186512768:12345-0@lo:400:kworker.0 Request processed in 57us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391605.773771:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391605.773785:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790391605.773790:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186513408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391605.773828:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186513408:12345-0@lo:400:kworker.0 Request processed in 38us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391605.773835:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790391605.773845:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790391605.773852:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186513536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391605.773898:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186513536:12345-0@lo:400:kworker.0 Request processed in 25us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391605.773905:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1790391605.773921:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391605.773924:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790391605.773957:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa2f800 x1877361186513536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391605.774345:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186513536:0@lo:400:kworker.0 00010000:00080000:1.0:1790391605.774362:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288347800 x1877361186512768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391605.774728:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186512768:0@lo:400:kworker.0 00010000:00080000:1.0:1790391605.774749:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183b7e680 x1877361186513408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391605.774759:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186513408:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.774953:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.775096:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790391605.775107:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186512512:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.775134:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.775155:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186513280:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.775177:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.775187:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186513792:0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.775204:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.775230:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186512640:0@lo:8:kworker.0 00000100:00100000:1.0:1790391605.775358:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186513664 00000100:00100000:1.0:1790391605.775364:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186513664 00000100:00100000:1.0:1790391605.775481:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186513280 00000100:00100000:1.0:1790391605.775484:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186513280 00000100:00100000:1.0:1790391605.775494:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186513792 00000100:00100000:1.0:1790391605.775497:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186513792 00000100:00100000:1.0:1790391605.775519:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790391605.775526:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186513664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391605.775570:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186513664:12345-0@lo:400:kworker.0 Request processed in 44us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391605.775577:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790391605.775591:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790391605.775597:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186513280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391605.775622:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186513280:12345-0@lo:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391605.775628:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790391605.775638:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790391605.775644:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186513792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391605.775668:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186513792:12345-0@lo:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391605.775674:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1790391605.775688:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391605.775692:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790391605.775753:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.775781:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186513152:0@lo:8:kworker.0 00000100:00100000:2.0:1790391605.775804:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.775841:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186512256 00000100:00100000:2.0:1790391605.775846:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186512256 00000100:00100000:2.0:1790391605.775901:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790391605.775908:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3637:x1877361186512256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.775943:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3637:x1877361186512256:12345-0@lo:400:kworker.0 Request processed in 36us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391605.775949:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790391605.775996:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186512896 00000100:00100000:2.0:1790391605.776001:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186512896 00000100:00100000:2.0:1790391605.776024:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186512384 00000100:00100000:2.0:1790391605.776028:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186512384 00000100:00100000:2.0:1790391605.776043:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391605.776048:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186512896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.776078:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186512896:12345-0@lo:400:kworker.0 Request processed in 30us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391605.776084:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790391605.776095:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391605.776100:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186512384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.776125:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186512384:12345-0@lo:400:kworker.0 Request processed in 24us (2926us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391605.776131:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790391605.776155:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186513024 00000100:00100000:2.0:1790391605.776159:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186513024 00000100:00100000:2.0:1790391605.776178:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186512512 00000100:00100000:2.0:1790391605.776187:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186512512 00000100:00100000:2.0:1790391605.776202:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186512640 00000100:00100000:2.0:1790391605.776205:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186512640 00000100:00100000:2.0:1790391605.776212:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186513152 00000100:00100000:2.0:1790391605.776214:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186513152 00000100:00100000:2.0:1790391605.776222:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391605.776228:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186513024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.776449:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186513024:12345-0@lo:400:kworker.0 Request processed in 30us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391605.776458:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790391605.776477:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391605.776484:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186512512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391605.776513:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186512512:12345-0@lo:400:kworker.0 Request processed in 31us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391605.776519:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790391605.776529:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391605.776533:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186512640:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790391605.776575:0:18708:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1790391605.776603:0:18708:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2b1b7949f13e249c 00002000:00100000:2.0:1790391605.776616:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e5182095800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790391605.776621:0:18708:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790391605.776624:0:18708:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790391605.776787:0:18708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790391605.776810:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9e5182096800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391605.776852:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1877361186512640:12345-0@lo:8:kworker.0 Request processed in 316us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391605.776857:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790391605.776902:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790391605.776907:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1877361186513152:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790391605.776921:0:18708:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1790391605.776934:0:18708:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2b1b7949f13e24a3 00002000:00100000:2.0:1790391605.776941:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e5182090000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1790391605.776944:0:18708:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1790391605.776945:0:18708:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790391605.778588:0:18708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1790391605.778618:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9e5182091800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391605.778679:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1877361186513152:12345-0@lo:8:kworker.0 Request processed in 1769us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391605.778688:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1790391605.778781:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288346300 x1877361186512640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391605.778796:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790391605.778805:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790391605.778810:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790391605.778812:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e5183835000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790391605.778825:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790391605.778830:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1877361186512640:0@lo:8:kworker.0 00010000:00080000:2.0:1790391605.778843:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288344e00 x1877361186513152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790391630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790391605.778853:0:3636:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1790391605.778857:0:3636:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790391605.778860:0:3636:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790391605.778862:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e51838d2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790391605.778907:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790391605.778912:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1877361186513152:0@lo:8:kworker.0 00000004:00080000:2.0:1790391605.778944:0:17227:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790391605.779539:0:17228:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1790391605.779563:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17228:1877361186514048:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790391605.779605:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391605.779630:0:17228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776c540 going to sleep for 11 seconds 00000004:00080000:1.0:1790391605.779657:0:17945:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790391605.779669:0:17945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bab480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1877361186514304:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1790391605.779691:0:17945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391605.779708:0:17945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528776cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790391605.779722:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186514048 00000100:00100000:1.0:1790391605.779737:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186514048 00000100:00100000:1.0:1790391605.779778:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186514304 00000100:00100000:1.0:1790391605.779782:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186514304 00000100:00100000:1.0:1790391605.779803:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790391605.779811:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17228:x1877361186514048:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790391605.780076:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391605.780094:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17945:x1877361186514304:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1790391605.780130:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186514176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391605.780159:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391605.780181:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391605.780186:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186513920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391605.780206:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391605.780236:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186514176 00000100:00100000:1.0:1790391605.780239:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186514176 00000100:00100000:1.0:1790391605.780256:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186513920 00000100:00100000:3.0:1790391605.782464:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186512512:0@lo:400:kworker.0 00010000:00080000:3.0:1790391605.782484:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288344380 x1877361186513280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391605.782494:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186513280:0@lo:400:kworker.0 00010000:00080000:3.0:1790391605.782515:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa2f100 x1877361186513792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391605.782523:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186513792:0@lo:400:kworker.0 00000100:00100000:3.0:1790391605.782535:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186512384:0@lo:400:kworker.0 00000100:00100000:3.0:1790391605.782547:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186513024:0@lo:400:kworker.0 00010000:00080000:3.0:1790391605.782562:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa2d880 x1877361186513664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391605.782570:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186513664:0@lo:400:kworker.0 00000100:00100000:1.0:1790391605.782780:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186513920 00000100:00100000:1.0:1790391605.782826:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391605.782836:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1877361186514176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391605.782897:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391605.782962:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1877361186514176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (2802us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391605.782969:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790391605.782984:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790391605.782990:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186513920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391605.782999:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391605.783020:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1877361186513920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (2813us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391605.783035:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1790391605.783067:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391605.783072:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790391605.783093:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183ba9180 x1877361186513920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391605.783109:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186513920:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1790391605.783120:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183baa680 x1877361186514176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790391621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391605.783131:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186514176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391605.783160:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186512256:0@lo:400:kworker.0 00000100:00100000:1.0:1790391605.783172:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186512896:0@lo:400:kworker.0 00000004:00080000:1.0:1790391605.783209:0:17944:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790391605.783575:0:17227:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 519150697310ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790391605.783584:0:17227:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1790391605.784787:0:17944:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 519151908394ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790391605.784795:0:17944:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1790391605.787202:0:17934:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1790391605.790444:0:18707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1790391605.790460:0:18707:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1790391605.790468:0:18707:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:2.0:1790391605.793294:0:19144:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1790391605.793303:0:19144:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1790391605.793472:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17945:x1877361186514304:12345-0@lo:7:osp-pre-1-1.0 Request processed in 13383us (13774us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391605.793483:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790391605.793540:0:17945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183bab480 x1877361186514304/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790391621 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391605.793556:0:17945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bab480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1877361186514304:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1790391605.793571:0:17945:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1790391605.793611:0:17945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1877361186514432:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790391605.793643:0:17945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.793666:0:17945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5182fb20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391605.793684:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186514432 00000100:00100000:2.0:1790391605.793690:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186514432 00000100:00100000:2.0:1790391605.793728:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790391605.793737:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17945:x1877361186514432:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1790391605.793762:0:18709:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1790391605.793792:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17945:x1877361186514432:12345-0@lo:5:osp-pre-1-1.0 Request processed in 57us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391605.793798:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1790391605.793824:0:17945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52bfa2e680 x1877361186514432/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790391621 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391605.793840:0:17945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1877361186514432:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1790391605.793848:0:17945:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1790391605.793872:0:17945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1877361186514560:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790391605.793915:0:17945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391605.793928:0:17945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5182fb20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790391605.793937:0:19144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186514560 00000100:00100000:2.0:1790391605.793941:0:19144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186514560 00000100:00100000:2.0:1790391605.795100:0:19144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790391605.795116:0:19144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17945:x1877361186514560:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1790391605.795149:0:19144:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:1.0:1790391605.798176:0:17182:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1790391605.799566:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.799574:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a800ba/0x2b1b7949f13e24aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.799597:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.799601:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.799605:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a800ba/0x2b1b7949f13e24aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.799618:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6a800ba/0x2b1b7949f13e24aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.799626:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a800ba/0x2b1b7949f13e24aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.799631:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a800ba/0x2b1b7949f13e24aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.799648:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790391605.800048:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.800052:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eaa569d/0x2b1b7949f13e24b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.800058:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.800060:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.800063:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eaa569d/0x2b1b7949f13e24b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.800069:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eaa569d/0x2b1b7949f13e24b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.800083:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eaa569d/0x2b1b7949f13e24b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.800087:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eaa569d/0x2b1b7949f13e24b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.800103:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790391605.800174:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790391605.800182:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6a800ba/0x2b1b7949f13e24aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.800193:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763d400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391605.800198:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a800ba/0x2b1b7949f13e24aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.800208:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a800ba/0x2b1b7949f13e24aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.800235:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6a800ba/0x2b1b7949f13e24aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.800244:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6a800ba/0x2b1b7949f13e24aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.800263:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391605.800267:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eaa569d/0x2b1b7949f13e24b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.800273:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763dc00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391605.800277:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eaa569d/0x2b1b7949f13e24b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.800284:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eaa569d/0x2b1b7949f13e24b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.800294:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eaa569d/0x2b1b7949f13e24b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.800301:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eaa569d/0x2b1b7949f13e24b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.800313:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391605.800315:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391605.800322:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.800529:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.800577:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.800581:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000473b28f6/0x2b1b7949f13e24b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.800587:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.800589:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.800592:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000473b28f6/0x2b1b7949f13e24b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.800600:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000473b28f6/0x2b1b7949f13e24b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.800607:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000473b28f6/0x2b1b7949f13e24b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.800615:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000473b28f6/0x2b1b7949f13e24b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.800644:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391605.801171:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391605.801178:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000473b28f6/0x2b1b7949f13e24b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.801186:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b763c600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391605.801190:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000473b28f6/0x2b1b7949f13e24b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.801198:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000473b28f6/0x2b1b7949f13e24b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.801210:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000473b28f6/0x2b1b7949f13e24b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.801218:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000473b28f6/0x2b1b7949f13e24b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.801234:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391605.801236:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391605.801238:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.801606:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.801614:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e24bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.801624:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.801628:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.801633:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e24bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.801643:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e24bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.801652:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e24bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.801659:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e24bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.801681:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391605.802063:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.802071:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e24bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.802079:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.802083:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e24bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.802092:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e24bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.802107:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e24bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.802127:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e24bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.802143:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.802145:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.802147:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.807735:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.807749:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e24c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.807766:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.807778:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.807785:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e24c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.807802:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e24c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.807814:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e24c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.807823:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e24c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.808049:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790391605.808474:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.808481:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e24cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.808493:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.809077:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.809083:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e24cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.809097:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e24cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.809106:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e24cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.809123:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e24cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.810509:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391605.810522:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e24c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.810535:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefa00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.810540:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e24c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.810551:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e24c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.810569:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e24c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.810577:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e24c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.810600:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.810603:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e24cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.810621:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.810624:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e24cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.810632:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e24cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.810643:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e24cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.810651:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.810653:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.810655:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391605.812972:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790391605.813037:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e24cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.813043:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.813648:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.813657:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e24d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.813671:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.813676:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.813683:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e24d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.813700:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e24d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.813711:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e24d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.813719:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e24d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.813750:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391605.813834:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.813842:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e24d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.813852:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.813857:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e24d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.813867:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e24d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.813908:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e24d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.813924:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e24d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.813942:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.813944:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.813946:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.814915:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.814925:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e24db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.814938:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.816821:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.816837:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e24db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.816859:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e24db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.816872:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e24db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.816903:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e24db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.816925:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391605.817628:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.817636:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e24db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.817646:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.817651:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e24db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.817662:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e24db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.817681:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e24db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.817688:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e24db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.817711:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.817713:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.817716:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391605.833483:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000001:00080000:1.0:1790391605.835972:0:19520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1790391605.835999:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1790391605.836004:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790391605.836605:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0701ec4/0x2b1b7949f13e24e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.836630:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=519s v=(0 0) 00010000:00010000:2.0:1790391605.836635:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391605.836643:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0701ec4/0x2b1b7949f13e24e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.836661:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0701ec4/0x2b1b7949f13e24e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.836675:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0701ec4/0x2b1b7949f13e24e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.836682:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0701ec4/0x2b1b7949f13e24e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.836702:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790391605.837625:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790391605.837636:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0701ec4/0x2b1b7949f13e24e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.837661:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391605.837666:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0701ec4/0x2b1b7949f13e24e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.837678:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0701ec4/0x2b1b7949f13e24e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.837696:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0701ec4/0x2b1b7949f13e24e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.837704:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0701ec4/0x2b1b7949f13e24e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391605.837727:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391605.837729:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790391605.837731:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391605.837789:0:19144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17945:x1877361186514560:12345-0@lo:5:osp-pre-1-1.0 Request processed in 42674us (43867us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790391605.837800:0:19144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391605.837860:0:17945:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790391605.837869:0:17945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17945:1877361186514560:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1790391605.837902:0:17945:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1790391605.837970:0:17945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17945:1877361186514688:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1790391605.838012:0:17945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391605.838049:0:17945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528881f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790391605.838772:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186514688 00000100:00100000:0.0:1790391605.838781:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186514688 00000100:00100000:0.0:1790391605.838828:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790391605.838837:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17945:x1877361186514688:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1790391605.838934:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17945:x1877361186514688:12345-0@lo:900:osp-pre-1-1.0 Request processed in 97us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391605.838942:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790391605.839045:0:17945:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183baa680 x1877361186514688/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790391621 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391605.839060:0:17945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17945:1877361186514688:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1790391605.839254:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391605.839263:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e24e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.839277:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=519s v=(0 0) 00010000:00010000:2.0:1790391605.839281:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391605.839288:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e24e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.839314:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e24e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.839325:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e24e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.839333:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e24e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.839348:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391605.840028:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391605.840036:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e24e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.840045:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391605.840050:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e24e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.840059:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e24e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.840077:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e24e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.840086:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff8f6a06/0x2b1b7949f13e24e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.840104:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.840106:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.840108:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391605.840382:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391605.840390:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cbc764a/0x2b1b7949f13e24f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.840400:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=519s v=(0 0) 00010000:00010000:2.0:1790391605.840416:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391605.840421:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cbc764a/0x2b1b7949f13e24f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.840432:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cbc764a/0x2b1b7949f13e24f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.840440:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cbc764a/0x2b1b7949f13e24f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.840461:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cbc764a/0x2b1b7949f13e24f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.840484:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391605.840844:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391605.840850:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cbc764a/0x2b1b7949f13e24f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.840859:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055c00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391605.840869:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cbc764a/0x2b1b7949f13e24f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.840912:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cbc764a/0x2b1b7949f13e24f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.840925:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cbc764a/0x2b1b7949f13e24f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.840933:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cbc764a/0x2b1b7949f13e24f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.840947:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391605.840948:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391605.840950:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391605.841751:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391605.841761:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008378439a/0x2b1b7949f13e24f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.841773:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=519s v=(0 0) 00010000:00010000:2.0:1790391605.841776:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391605.841782:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008378439a/0x2b1b7949f13e24f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.841794:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008378439a/0x2b1b7949f13e24f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.841802:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008378439a/0x2b1b7949f13e24f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.841810:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008378439a/0x2b1b7949f13e24f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.841840:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790391605.842488:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790391605.842606:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391605.842614:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008378439a/0x2b1b7949f13e24f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.842625:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391605.842629:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008378439a/0x2b1b7949f13e24f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.842651:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008378439a/0x2b1b7949f13e24f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.842667:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008378439a/0x2b1b7949f13e24f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.842675:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008378439a/0x2b1b7949f13e24f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.842694:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.842695:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.842697:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.842729:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006f68b05/0x2b1b7949f13e24fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.842744:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=519s v=(0 0) 00010000:00010000:2.0:1790391605.842748:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391605.842753:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006f68b05/0x2b1b7949f13e24fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.842764:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006f68b05/0x2b1b7949f13e24fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.842774:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006f68b05/0x2b1b7949f13e24fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.842782:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006f68b05/0x2b1b7949f13e24fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.842802:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790391605.843145:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391605.843151:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006f68b05/0x2b1b7949f13e24fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.843159:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391605.843162:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006f68b05/0x2b1b7949f13e24fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.843171:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006f68b05/0x2b1b7949f13e24fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.843181:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006f68b05/0x2b1b7949f13e24fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.843196:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006f68b05/0x2b1b7949f13e24fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.843212:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391605.843214:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391605.843215:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790391605.843348:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790391605.843355:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c22b50/0x2b1b7949f13e2505 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.843363:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=519s v=(0 0) 00010000:00010000:2.0:1790391605.843366:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391605.843370:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c22b50/0x2b1b7949f13e2505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.843380:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c22b50/0x2b1b7949f13e2505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.843399:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c22b50/0x2b1b7949f13e2505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.843416:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046c22b50/0x2b1b7949f13e2505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.843466:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790391605.846919:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.846937:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e250c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.846956:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.846961:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.846968:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e250c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.846995:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e250c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.847007:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e250c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.847016:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e250c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.852720:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790391605.852739:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046c22b50/0x2b1b7949f13e2505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.852755:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391605.852761:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c22b50/0x2b1b7949f13e2505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.852773:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c22b50/0x2b1b7949f13e2505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.852795:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046c22b50/0x2b1b7949f13e2505 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.852861:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c22b50/0x2b1b7949f13e2505 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.854010:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391605.854023:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e250c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.854035:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391605.854040:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e250c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.854051:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e250c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.854071:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e250c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.854081:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.854083:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.854086:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391605.854486:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790391605.854497:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081abdf2c/0x2b1b7949f13e250c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.854665:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.858618:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.858636:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e936366b/0x2b1b7949f13e2513 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.858655:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.858666:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.858673:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e936366b/0x2b1b7949f13e2513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.858689:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e936366b/0x2b1b7949f13e2513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.858699:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e936366b/0x2b1b7949f13e2513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.858706:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e936366b/0x2b1b7949f13e2513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.858734:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391605.861006:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391605.861020:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e936366b/0x2b1b7949f13e2513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.861034:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391605.861060:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e936366b/0x2b1b7949f13e2513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.861072:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e936366b/0x2b1b7949f13e2513 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.861092:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e936366b/0x2b1b7949f13e2513 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.861100:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e936366b/0x2b1b7949f13e2513 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.861125:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.861127:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.861129:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.861381:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.861390:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069628fb7/0x2b1b7949f13e251a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.861402:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.861418:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.861431:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069628fb7/0x2b1b7949f13e251a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.861445:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069628fb7/0x2b1b7949f13e251a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.861453:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069628fb7/0x2b1b7949f13e251a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.861461:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069628fb7/0x2b1b7949f13e251a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.861487:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391605.862020:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391605.862028:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069628fb7/0x2b1b7949f13e251a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.862037:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391605.862042:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069628fb7/0x2b1b7949f13e251a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.862058:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069628fb7/0x2b1b7949f13e251a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.862072:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069628fb7/0x2b1b7949f13e251a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.862086:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069628fb7/0x2b1b7949f13e251a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.862103:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.862105:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.862107:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.862203:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.862209:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e2521 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.862218:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.862221:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.862226:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e2521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.862236:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e2521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.862244:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e2521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.862264:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e2521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.862285:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790391605.863256:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.863267:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b56712/0x2b1b7949f13e2528 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.863279:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.863282:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.863287:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b56712/0x2b1b7949f13e2528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.863299:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5b56712/0x2b1b7949f13e2528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.863309:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b56712/0x2b1b7949f13e2528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.863316:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b56712/0x2b1b7949f13e2528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.863530:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790391605.863535:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790391605.863545:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e2521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.863556:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.863560:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e2521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.863572:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e2521 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.863600:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e2521 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.863609:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc441bd/0x2b1b7949f13e2521 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.863643:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.863646:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5b56712/0x2b1b7949f13e2528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.863653:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eeec00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.863656:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b56712/0x2b1b7949f13e2528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.863664:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b56712/0x2b1b7949f13e2528 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.863676:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5b56712/0x2b1b7949f13e2528 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.863684:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b56712/0x2b1b7949f13e2528 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.863695:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.863697:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.863699:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.864253:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.864261:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e252f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.864276:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.864279:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.864284:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e252f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.864295:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e252f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.864304:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e252f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.864311:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e252f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.864329:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391605.864487:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.864493:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e252f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.864502:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefe00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.864512:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e252f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.864522:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e252f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.864534:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e252f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.864541:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078793e21/0x2b1b7949f13e252f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.864559:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.864560:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.864562:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.864830:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.864837:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2536 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.864846:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.864850:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.864854:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.864864:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.864914:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.864921:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.864931:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391605.865099:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.865104:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.865111:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eee600 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.865115:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.865123:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2536 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.865134:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2536 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.865147:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c19a3d75/0x2b1b7949f13e2536 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.865162:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.865175:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.865177:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.865752:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.865759:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e253d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.865770:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.865773:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.865778:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e253d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.865788:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e253d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.865796:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e253d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.865803:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e253d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.865836:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391605.866024:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.866030:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e253d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.866037:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eefa00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.866041:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e253d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.866050:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e253d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.866063:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e253d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.866070:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9da2439/0x2b1b7949f13e253d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.866098:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.866100:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.866102:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.866333:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.866339:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e2544 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.866347:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.866351:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.866355:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e2544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.866364:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e2544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.866372:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e2544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.866380:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e2544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.866399:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391605.866530:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.866536:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e2544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.866543:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.866546:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e2544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.866554:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e2544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.866565:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e2544 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.866573:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e719dc5/0x2b1b7949f13e2544 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.866588:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.866590:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.866591:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.866924:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.866931:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e254b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.866940:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.866951:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.866956:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e254b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.866967:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e254b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.866975:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e254b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.866981:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e254b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.866996:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391605.867241:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.867246:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e254b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.867254:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.867258:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e254b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.867278:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e254b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.867289:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e254b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.867298:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6dda782/0x2b1b7949f13e254b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.867315:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.867317:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.867319:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.867587:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.867593:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2552 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.867602:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.867606:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.867610:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.867620:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.867628:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.867642:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.867661:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790391605.867789:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790391605.867795:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.867802:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:2.0:1790391605.867806:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.867814:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.867826:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2552 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.867844:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002536b386/0x2b1b7949f13e2552 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391605.867860:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.867862:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391605.867864:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.868144:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.869652:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.869664:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2559 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.869679:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.869683:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.869689:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.869702:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.869711:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.869718:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.869745:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391605.869771:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391605.869779:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.869789:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280031e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391605.869794:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.869803:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2559 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.869821:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2559 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.869830:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009550a154/0x2b1b7949f13e2559 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.869850:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.869852:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.869866:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.872170:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.872186:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2560 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.872215:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.872220:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.872227:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.872243:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.872253:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.872260:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.872276:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790391605.872354:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391605.872363:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.872373:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030e00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391605.872379:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.872390:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.872434:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2560 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.872442:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fa0e299/0x2b1b7949f13e2560 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.872463:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.872465:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.872466:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790391605.872912:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790391605.872919:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2567 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.872928:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1790391605.872931:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391605.872936:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.872947:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.872968:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.872975:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391605.873050:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790391605.873092:0:18707:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1790391605.873190:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17228:x1877361186514048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 93375us (93580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391605.873200:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790391605.873257:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17228:1877361186514048:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790391605.873272:0:17228:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1790391605.873318:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17228:1877361186514816:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790391605.874951:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391605.875057:0:17228:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae89e300 going to sleep for 11 seconds 00000100:00100000:3.0:1790391605.875093:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186514816 00000100:00100000:3.0:1790391605.875102:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186514816 00000100:00100000:3.0:1790391605.875148:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391605.875157:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17228:x1877361186514816:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790391605.875200:0:18708:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1790391605.875686:0:17190:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391605.875696:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.875709:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5280030400 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391605.875714:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.875737:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.875758:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2567 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.875766:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2f5bb09/0x2b1b7949f13e2567 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391605.875792:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.875794:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391605.875796:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391605.883773:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17228:x1877361186514816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8610us (8824us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790391605.883787:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391605.884250:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17228:1877361186514816:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790391605.884269:0:17228:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1790391606.794241:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790391606.889791:0:19876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg228-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790391607.816405:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391607.817684:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391607.817707:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186514944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391607.817776:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391607.817824:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186514944 00000100:00100000:3.0:1790391607.817832:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186514944 00000100:00100000:3.0:1790391607.817911:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391607.817921:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186514944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391607.817951:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790391607.817997:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186514944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391607.818004:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1790391607.818030:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391607.818079:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186514944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391607.818408:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186515072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391607.818437:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391607.818571:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186515072 00000100:00100000:0.0:1790391607.818576:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186515072 00000100:00100000:0.0:1790391607.818614:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391607.818620:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186515072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790391607.818631:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790391607.818664:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186515072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391607.818670:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790391607.818699:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186515072:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790391607.818834:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1790391607.844627:0:19928:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391607.845146:0:19928:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790391608.330686:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391608.330711:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186515200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391608.330806:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391608.330977:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186515200 00000100:00100000:2.0:1790391608.330986:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186515200 00000100:00100000:2.0:1790391608.331036:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391608.331047:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186515200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391608.331083:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790391608.331133:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186515200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391608.331140:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790391608.331183:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186515200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790391608.331974:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186515328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391608.332012:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391608.332080:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186515328 00000100:00100000:1.0:1790391608.332098:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186515328 00000100:00100000:1.0:1790391608.332140:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790391608.332147:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186515328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391608.332172:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790391608.332211:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186515328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391608.332218:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790391608.332731:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186515328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790391608.842698:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790391608.893581:0:19979:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790391608.894263:0:19979:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790391609.264307:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391609.264389:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169648512 00000100:00100000:3.0:1790391609.264399:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169648512 00000100:00100000:3.0:1790391609.264451:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 114 00000100:00100000:3.0:1790391609.264466:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2380:x1877361169648512:12345-192.168.202.28@tcp:250:mount.lustre.0 00010000:00080000:3.0:1790391609.264494:0:17194:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from de820afa-b30f-4af2-bd45-eaefa881a982@192.168.202.28@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:3.0:1790391609.264526:0:17194:0:(genops.c:1385:class_connect()) connect: client de820afa-b30f-4af2-bd45-eaefa881a982, cookie 0x2b1b7949f13e256e 00000100:00080000:3.0:1790391609.264650:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9e51810c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391609.264830:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+5:2380:x1877361169648512:12345-192.168.202.28@tcp:250:mount.lustre.0 Request processed in 369us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391609.264850:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 114 00000100:00100000:2.0:1790391609.276926:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391609.280381:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169648640 00000100:00100000:3.0:1790391609.280405:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169648640 00000100:00100000:3.0:1790391609.280517:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 115 00000100:00100000:3.0:1790391609.280530:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+5:14898:x1877361169648640:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790391609.280551:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391609.280577:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e2575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b04e2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.281077:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e2575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04e2 expref: 6 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.281093:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280030600/0x2b1b7949f13e2575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04e2 expref: 6 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.281104:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280030600, rc 0) 00000100:00100000:3.0:1790391609.281202:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+6:14898:x1877361169648640:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 674us (4325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391609.281210:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 115 00000100:00100000:0.0:1790391609.291661:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391609.291866:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169648768 00000100:00100000:2.0:1790391609.291936:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169648768 00000100:00100000:2.0:1790391609.292028:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 116 00000100:00100000:2.0:1790391609.292041:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+6:14898:x1877361169648768:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790391609.292225:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+6:14898:x1877361169648768:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 186us (576us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790391609.292234:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 116 00000100:00100000:0.0:1790391609.302637:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391609.302973:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169648896 00000100:00100000:3.0:1790391609.302988:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169648896 00000100:00100000:3.0:1790391609.303067:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 117 00000100:00100000:3.0:1790391609.303081:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+6:14898:x1877361169648896:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790391609.303105:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391609.303134:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e257c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b04e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.303198:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e257c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04e9 expref: 7 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.303211:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280031a00/0x2b1b7949f13e257c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b04e9 expref: 7 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.303220:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031a00, rc 0) 00000100:00100000:3.0:1790391609.303506:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+7:14898:x1877361169648896:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 426us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391609.303515:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 117 00000100:00100000:3.0:1790391609.309398:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391609.309565:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169649024 00000100:00100000:0.0:1790391609.309578:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169649024 00000100:00100000:0.0:1790391609.309721:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 118 00000100:00100000:0.0:1790391609.309733:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+7:14898:x1877361169649024:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790391609.310472:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+8:14898:x1877361169649024:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 737us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391609.310484:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 118 00000100:00100000:0.0:1790391609.314513:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391609.314687:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169649152 00000100:00100000:2.0:1790391609.314698:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169649152 00000100:00100000:2.0:1790391609.314789:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 119 00000100:00100000:2.0:1790391609.314801:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+8:14898:x1877361169649152:12345-192.168.202.28@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790391609.315076:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+8:14898:x1877361169649152:12345-192.168.202.28@tcp:503:mount.lustre.0 Request processed in 276us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391609.315085:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 119 00000100:00100000:3.0:1790391609.321960:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391609.322245:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169649280 00000100:00100000:1.0:1790391609.322260:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169649280 00000100:00100000:1.0:1790391609.322328:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 120 00000100:00100000:1.0:1790391609.322342:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+8:14917:x1877361169649280:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391609.322560:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+8:14917:x1877361169649280:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 221us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391609.322568:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 120 00000100:00100000:0.0:1790391609.356253:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391609.356385:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169649408 00000100:00100000:1.0:1790391609.356400:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169649408 00000100:00100000:1.0:1790391609.356474:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 121 00000100:00100000:1.0:1790391609.356485:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+8:14917:x1877361169649408:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391609.356697:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+8:14917:x1877361169649408:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 213us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391609.356706:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 121 00000100:00100000:1.0:1790391609.377260:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391609.377415:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169649536 00000100:00100000:3.0:1790391609.377430:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169649536 00000100:00100000:3.0:1790391609.377504:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 122 00000100:00100000:3.0:1790391609.377517:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+8:14917:x1877361169649536:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790391609.377736:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+8:14917:x1877361169649536:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 221us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391609.377744:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 122 00000100:00100000:3.0:1790391609.386698:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391609.390660:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169649664 00000100:00100000:2.0:1790391609.394852:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169649664 00000100:00100000:2.0:1790391609.394984:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 123 00000100:00100000:2.0:1790391609.394997:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+8:14898:x1877361169649664:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790391609.395021:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391609.395046:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309d800/0x2b1b7949f13e2583 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b051a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391609.395085:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309d800/0x2b1b7949f13e2583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b051a expref: 9 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391609.395099:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309d800/0x2b1b7949f13e2583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b051a expref: 9 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391609.395134:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d800, rc 0) 00000100:00100000:2.0:1790391609.395232:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+9:14898:x1877361169649664:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 237us (8547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391609.395240:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 123 00000100:00100000:0.0:1790391609.405632:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391609.405749:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169649792 00000100:00100000:1.0:1790391609.405763:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169649792 00000100:00100000:1.0:1790391609.405839:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 124 00000100:00100000:1.0:1790391609.405851:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+9:14898:x1877361169649792:12345-192.168.202.28@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790391609.405973:0:17194:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790391609.405996:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790391609.406001:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790391609.406005:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790391609.406009:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1790391609.406011:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000040:00080000:2.0:1790391609.421817:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790391609.422624:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+9:14898:x1877361169649792:12345-192.168.202.28@tcp:256:mount.lustre.0 Request processed in 16763us (16993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391609.422641:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 124 00000100:00100000:3.0:1790391609.432510:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391609.432989:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169649920 00000100:00100000:2.0:1790391609.433003:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169649920 00000100:00100000:2.0:1790391609.433075:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 125 00000100:00100000:2.0:1790391609.433087:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+9:14898:x1877361169649920:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790391609.433111:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391609.433136:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309ca00/0x2b1b7949f13e258a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0521 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391609.433173:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309ca00/0x2b1b7949f13e258a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0521 expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391609.433186:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309ca00/0x2b1b7949f13e258a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0521 expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391609.433197:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ca00, rc 0) 00000100:00100000:2.0:1790391609.433419:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+10:14898:x1877361169649920:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 332us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391609.433428:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 125 00000100:00100000:1.0:1790391609.437404:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391609.437548:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169650048 00000100:00100000:3.0:1790391609.437580:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169650048 00000100:00100000:3.0:1790391609.437653:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 126 00000100:00100000:3.0:1790391609.437665:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+10:14898:x1877361169650048:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790391609.437927:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+10:14898:x1877361169650048:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 264us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391609.437937:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 126 00000100:00100000:1.0:1790391609.444542:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391609.444713:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169650176 00000100:00100000:3.0:1790391609.444728:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169650176 00000100:00100000:3.0:1790391609.444802:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 127 00000100:00100000:3.0:1790391609.444813:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+10:14898:x1877361169650176:12345-192.168.202.28@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790391609.445225:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518324c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+10:14898:x1877361169650176:12345-192.168.202.28@tcp:503:mount.lustre.0 Request processed in 410us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391609.445235:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 127 00000100:00100000:0.0:1790391609.449830:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391609.450113:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169650304 00000100:00100000:2.0:1790391609.450126:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169650304 00000100:00100000:2.0:1790391609.450198:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 128 00000100:00100000:2.0:1790391609.450226:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+10:14923:x1877361169650304:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391609.450760:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+10:14923:x1877361169650304:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 531us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391609.450771:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 128 00000100:00100000:0.0:1790391609.471046:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391609.471215:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169650432 00000100:00100000:1.0:1790391609.471229:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169650432 00000100:00100000:1.0:1790391609.471308:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 129 00000100:00100000:1.0:1790391609.471320:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+10:14923:x1877361169650432:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790391609.471543:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+10:14923:x1877361169650432:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 224us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391609.471553:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 129 00000100:00100000:1.0:1790391609.479478:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391609.479710:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169650560 00000100:00100000:2.0:1790391609.479723:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169650560 00000100:00100000:2.0:1790391609.479791:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:2.0:1790391609.479802:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2380:x1877361169650560:12345-192.168.202.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790391609.479850:0:17202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 89b7dd42-ca89-4c21-9061-6e0347f78f2b@192.168.202.28@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:2.0:1790391609.479970:0:17202:0:(genops.c:1385:class_connect()) connect: client 89b7dd42-ca89-4c21-9061-6e0347f78f2b, cookie 0x2b1b7949f13e2591 00000004:00100000:2.0:1790391609.480005:0:17202:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790391609.480506:0:17202:0:(import.c:65:import_set_state_nolock()) ffff9e5182ddf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391609.480608:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:2380:x1877361169650560:12345-192.168.202.28@tcp:38:mount.lustre.0 Request processed in 806us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391609.480618:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:0.0:1790391609.485737:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391609.486660:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169650816 00000100:00100000:2.0:1790391609.486675:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169650816 00000100:00100000:2.0:1790391609.486749:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:2.0:1790391609.486760:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2380:x1877361169650816:12345-192.168.202.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790391609.486807:0:17201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 89b7dd42-ca89-4c21-9061-6e0347f78f2b@192.168.202.28@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:2.0:1790391609.487141:0:17201:0:(genops.c:1385:class_connect()) connect: client 89b7dd42-ca89-4c21-9061-6e0347f78f2b, cookie 0x2b1b7949f13e2598 00000004:00100000:2.0:1790391609.487176:0:17201:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790391609.487830:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9e5182ddb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391609.488658:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:2380:x1877361169650816:12345-192.168.202.28@tcp:38:mount.lustre.0 Request processed in 1629us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391609.488687:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:1.0:1790391609.497611:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391609.497658:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391609.497699:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391609.497806:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169650688 00000100:00100000:0.0:1790391609.497821:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169650688 00000100:00100000:0.0:1790391609.497945:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169650944 00000100:00100000:0.0:1790391609.497958:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169650944 00000100:00100000:0.0:1790391609.497977:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169651072 00000100:00100000:0.0:1790391609.497980:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169651072 00000100:00100000:0.0:1790391609.497997:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:0.0:1790391609.498009:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:0:x1877361169650688:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391609.498070:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790391609.498201:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:0:x1877361169650688:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 193us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391609.498229:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:0.0:1790391609.498252:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:0.0:1790391609.498258:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:0:x1877361169650944:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391609.498281:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391609.498340:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:0:x1877361169650944:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 82us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391609.498347:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:0.0:1790391609.498360:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:0.0:1790391609.498367:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14898:x1877361169651072:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391609.498390:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790391609.498415:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14898:x1877361169651072:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 48us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391609.498422:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00080000:1.0:1790391609.498929:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790391609.498935:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391609.508858:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391609.511409:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169651200 00000100:00100000:0.0:1790391609.511430:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169651200 00000100:00100000:2.0:1790391609.516207:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:2.0:1790391609.516226:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14898:x1877361169651200:12345-192.168.202.28@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790391609.516364:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14898:x1877361169651200:12345-192.168.202.28@tcp:40:mount.lustre.0 Request processed in 141us (7519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391609.516383:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:0.0:1790391609.534946:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391609.534999:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391609.535162:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169651328 00000100:00100000:1.0:1790391609.535178:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169651328 00000100:00100000:1.0:1790391609.535240:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169651456 00000100:00100000:1.0:1790391609.535244:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169651456 00000100:00100000:1.0:1790391609.535275:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:1.0:1790391609.535287:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2380:x1877361169651328:12345-192.168.202.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790391609.535363:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 89b7dd42-ca89-4c21-9061-6e0347f78f2b@192.168.202.28@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:1.0:1790391609.535415:0:18707:0:(genops.c:1385:class_connect()) connect: client 89b7dd42-ca89-4c21-9061-6e0347f78f2b, cookie 0x2b1b7949f13e259f 00002000:00100000:1.0:1790391609.535432:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 89b7dd42-ca89-4c21-9061-6e0347f78f2b/ffff9e518214c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790391609.535448:0:18707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790391609.535695:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790391609.535738:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9e5182148800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391609.535827:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:2380:x1877361169651328:12345-192.168.202.28@tcp:8:mount.lustre.0 Request processed in 541us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391609.535836:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:1.0:1790391609.535856:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:1.0:1790391609.535860:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2380:x1877361169651456:12345-192.168.202.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790391609.535927:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 89b7dd42-ca89-4c21-9061-6e0347f78f2b@192.168.202.28@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:1.0:1790391609.535948:0:18707:0:(genops.c:1385:class_connect()) connect: client 89b7dd42-ca89-4c21-9061-6e0347f78f2b, cookie 0x2b1b7949f13e25a6 00002000:00100000:1.0:1790391609.535954:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 89b7dd42-ca89-4c21-9061-6e0347f78f2b/ffff9e518214c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790391609.535969:0:18707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790391609.536094:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790391609.536111:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9e518214f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790391609.536137:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:2380:x1877361169651456:12345-192.168.202.28@tcp:8:mount.lustre.0 Request processed in 275us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391609.536144:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:0.0:1790391609.546628:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391609.546774:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169651584 00000100:00100000:3.0:1790391609.547097:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169651584 00000100:00100000:3.0:1790391609.547182:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:3.0:1790391609.547195:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14898:x1877361169651584:12345-192.168.202.28@tcp:900:mount.lustre.0 00000100:00100000:3.0:1790391609.547540:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14898:x1877361169651584:12345-192.168.202.28@tcp:900:mount.lustre.0 Request processed in 346us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391609.547550:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:1.0:1790391609.561964:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391609.563225:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169651712 00000100:00100000:0.0:1790391609.563256:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169651712 00000100:00100000:0.0:1790391609.563354:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:0.0:1790391609.563367:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14898:x1877361169651712:12345-192.168.202.28@tcp:33:mount.lustre.0 00000004:00080000:1.0:1790391609.566182:0:17204:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2673us 00000004:00200000:1.0:1790391609.607131:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790391609.607281:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14898:x1877361169651712:12345-192.168.202.28@tcp:33:mount.lustre.0 Request processed in 43911us (45335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391609.607295:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00010000:00010000:1.0:1790391609.864551:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391609.872063:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391609.872273:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169651840 00000100:00100000:3.0:1790391609.872284:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169651840 00000100:00100000:3.0:1790391609.872342:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:3.0:1790391609.872353:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14946:x1877361169651840:12345-192.168.202.28@tcp:101:mkdir.0 00010000:00010000:3.0:1790391609.872384:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391609.872422:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e25ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0552 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.872492:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e25b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.872506:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e25b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.872520:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e25b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391609.872572:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790391609.872576:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391609.872622:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e25b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.872657:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031800/0x2b1b7949f13e25ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0552 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.872676:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e25b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0552 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391609.872684:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bba00) 00010000:00010000:3.0:1790391609.872687:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391609.872690:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031400, rc 0) 00000100:00100000:3.0:1790391609.872859:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:14946:x1877361169651840:12345-192.168.202.28@tcp:101:mkdir.0 Request processed in 507us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391609.872867:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00010000:00010000:2.0:1790391610.888976:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391610.890288:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186515456:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.890393:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391610.890453:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186515968:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.890536:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391610.890553:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186516480:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.890573:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391610.890586:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186516992:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.890610:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391610.890907:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186515712:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.890950:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391610.890972:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186516224:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.890991:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391610.891005:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186516736:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891024:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391610.891037:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790391610.891043:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186515840:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891065:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391610.891082:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186516352:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891101:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391610.891117:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186516864:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891134:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391610.891158:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186515712 00000100:00100000:3.0:1790391610.891164:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186515712 00000100:00100000:3.0:1790391610.891216:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186516224 00000100:00100000:3.0:1790391610.891219:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186516224 00000100:00100000:3.0:1790391610.891231:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186515840 00000100:00100000:3.0:1790391610.891234:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186515840 00000100:00100000:3.0:1790391610.891245:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186516352 00000100:00100000:3.0:1790391610.891248:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186516352 00000100:00100000:3.0:1790391610.891263:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391610.891272:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186515712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891323:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186515712:12345-0@lo:400:kworker.0 Request processed in 52us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391610.891330:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790391610.891346:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391610.891352:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186516224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891403:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186516224:12345-0@lo:400:kworker.0 Request processed in 51us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391610.891409:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790391610.891421:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391610.891427:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186515840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891453:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1877361186515840:12345-0@lo:400:kworker.0 Request processed in 26us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391610.891459:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790391610.891467:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790391610.891604:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186516352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891751:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186516352:12345-0@lo:400:kworker.0 Request processed in 161us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391610.891760:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1790391610.891778:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790391610.891782:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790391610.891812:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186515840:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891823:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186516352:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891831:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186515712:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891838:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186516224:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.891945:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186515968 00000100:00100000:3.0:1790391610.891950:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186515968 00000100:00100000:3.0:1790391610.891973:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186516480 00000100:00100000:3.0:1790391610.891975:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186516480 00000100:00100000:3.0:1790391610.891985:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186516992 00000100:00100000:3.0:1790391610.891987:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186516992 00000100:00100000:3.0:1790391610.892015:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186516736 00000100:00100000:3.0:1790391610.892018:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186516736 00000100:00100000:3.0:1790391610.892028:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186516864 00000100:00100000:3.0:1790391610.892031:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186516864 00000100:00100000:3.0:1790391610.892043:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391610.892049:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186515968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.892080:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877361186515968:12345-0@lo:400:kworker.0 Request processed in 31us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391610.892085:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790391610.892095:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790391610.892099:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186516480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.892120:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186516480:12345-0@lo:400:kworker.0 Request processed in 21us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391610.892125:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790391610.892133:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391610.892138:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186516992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.892159:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186516992:12345-0@lo:400:kworker.0 Request processed in 21us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391610.892164:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790391610.892173:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391610.892178:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186516736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.892221:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877361186516736:12345-0@lo:400:kworker.0 Request processed in 43us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391610.892227:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790391610.892239:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790391610.892244:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186516864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.892279:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877361186516864:12345-0@lo:400:kworker.0 Request processed in 34us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391610.892285:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1790391610.892299:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790391610.892302:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790391610.892319:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1877361186516864:0@lo:400:kworker.0 00010000:00080000:3.0:1790391610.892333:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288345f80 x1877361186516736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391610.892342:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1877361186516736:0@lo:400:kworker.0 00000100:00100000:3.0:1790391610.892394:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186517120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391610.892422:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391610.892564:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790391610.892580:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186515584:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.892607:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391610.892625:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186516096:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.892768:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391610.892786:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186516608:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.892806:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391610.892832:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877361186515968:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.892842:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186516480:0@lo:400:kworker.0 00010000:00080000:1.0:1790391610.892852:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5288346680 x1877361186516992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391610.892861:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186516992:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.893150:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186515584 00000100:00100000:1.0:1790391610.893154:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186515584 00000100:00100000:1.0:1790391610.893178:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186516096 00000100:00100000:1.0:1790391610.893180:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186516096 00000100:00100000:1.0:1790391610.893190:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790391610.893195:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186515584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.893235:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186515584:12345-0@lo:400:kworker.0 Request processed in 40us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391610.893241:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790391610.893254:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391610.893259:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186516096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.893284:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186516096:12345-0@lo:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391610.893291:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790391610.893309:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186516608 00000100:00100000:1.0:1790391610.893312:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186516608 00000100:00100000:1.0:1790391610.893343:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790391610.893349:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186516608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.893387:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877361186516608:12345-0@lo:400:kworker.0 Request processed in 38us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391610.893392:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1790391610.893416:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391610.893433:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186515584:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.893442:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186516096:0@lo:400:kworker.0 00000100:00100000:1.0:1790391610.893453:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5288345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1877361186516608:0@lo:400:kworker.0 00000100:00100000:2.0:1790391610.893680:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186515456 00000100:00100000:2.0:1790391610.893685:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186515456 00000100:00100000:2.0:1790391610.893716:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790391610.893723:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3639:x1877361186515456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391610.893756:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3639:x1877361186515456:12345-0@lo:400:kworker.0 Request processed in 34us (3364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391610.893763:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790391610.894726:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186515456:0@lo:400:kworker.0 00000100:00100000:0.0:1790391610.894957:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186517120 00000100:00100000:0.0:1790391610.894974:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186517120 00000100:00100000:0.0:1790391610.895010:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391610.895017:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186517120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391610.895041:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790391610.895097:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877361186517120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (2674us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391610.895103:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391610.895150:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186517120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790391610.897490:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391610.897519:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186517248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391610.897595:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391610.898300:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186517248 00000100:00100000:0.0:1790391610.898310:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186517248 00000100:00100000:0.0:1790391610.898385:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391610.898395:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186517248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790391610.898417:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790391610.898468:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186517248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391610.898487:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790391610.899112:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186517248:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1790391611.401976:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000001:00080000:1.0:1790391611.401997:0:19520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:0.0:1790391611.913670:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391612.193150:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391612.193384:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169651968 00000100:00100000:1.0:1790391612.193396:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169651968 00000100:00080000:3.0:1790391612.193546:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790391612.193626:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:1.0:1790391612.193639:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:14998:x1877361169651968:12345-192.168.202.28@tcp:41:lfs.0 00000004:00000024:1.0:1790391612.193681:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790391612.193795:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:14998:x1877361169651968:12345-192.168.202.28@tcp:41:lfs.0 Request processed in 159us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391612.193804:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:1.0:1790391612.198244:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391612.198439:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169652096 00000100:00100000:3.0:1790391612.198451:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169652096 00000100:00100000:3.0:1790391612.198530:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:3.0:1790391612.198541:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14998:x1877361169652096:12345-192.168.202.28@tcp:41:lfs.0 00000004:00000024:3.0:1790391612.198584:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790391612.198688:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14998:x1877361169652096:12345-192.168.202.28@tcp:41:lfs.0 Request processed in 148us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391612.198696:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00080000:1.0:1790391612.198761:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790391612.201932:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.202093:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169652224 00000100:00100000:2.0:1790391612.202104:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169652224 00000100:00100000:2.0:1790391612.202223:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:2.0:1790391612.202234:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14998:x1877361169652224:12345-192.168.202.28@tcp:13:lfs.0 00002000:00000024:2.0:1790391612.202272:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790391612.202610:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:14998:x1877361169652224:12345-192.168.202.28@tcp:13:lfs.0 Request processed in 376us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.202625:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00080000:1.0:1790391612.202872:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391612.205420:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.205728:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169652352 00000100:00100000:2.0:1790391612.205739:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169652352 00000100:00100000:2.0:1790391612.205808:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00100000:2.0:1790391612.205818:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:14998:x1877361169652352:12345-192.168.202.28@tcp:13:lfs.0 00002000:00000024:2.0:1790391612.205844:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790391612.205969:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:14998:x1877361169652352:12345-192.168.202.28@tcp:13:lfs.0 Request processed in 152us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.205977:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 12 00000100:00080000:1.0:1790391612.206146:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790391612.454483:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.454588:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169652480 00000100:00100000:2.0:1790391612.454597:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169652480 00000100:00100000:2.0:1790391612.454664:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 131 00000100:00100000:2.0:1790391612.454674:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+10:15034:x1877361169652480:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790391612.454689:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391612.454707:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309c200/0x2b1b7949f13e25bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0559 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391612.454735:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309c200/0x2b1b7949f13e25bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0559 expref: 11 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391612.454747:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309c200/0x2b1b7949f13e25bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0559 expref: 11 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391612.454756:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c200, rc 0) 00000100:00100000:2.0:1790391612.454810:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+11:15034:x1877361169652480:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 138us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.454833:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 131 00000100:00100000:3.0:1790391612.460756:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.460865:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169652608 00000100:00100000:2.0:1790391612.460906:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169652608 00000100:00100000:2.0:1790391612.460964:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 132 00000100:00100000:2.0:1790391612.460975:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+11:15034:x1877361169652608:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790391612.461203:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+11:15034:x1877361169652608:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 229us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.461211:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 132 00000100:00100000:1.0:1790391612.475026:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391612.475226:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169652736 00000100:00100000:0.0:1790391612.475237:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169652736 00000100:00100000:0.0:1790391612.475369:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 133 00000100:00100000:0.0:1790391612.475381:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+11:15034:x1877361169652736:12345-192.168.202.28@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790391612.475543:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+11:15034:x1877361169652736:12345-192.168.202.28@tcp:503:mount.lustre.0 Request processed in 163us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391612.475560:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 133 00000100:00100000:1.0:1790391612.481235:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391612.481523:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169652864 00000100:00100000:3.0:1790391612.481533:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169652864 00000100:00100000:3.0:1790391612.481594:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 134 00000100:00100000:3.0:1790391612.481604:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+11:15038:x1877361169652864:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790391612.481783:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+11:15038:x1877361169652864:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 179us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391612.481792:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 134 00000100:00100000:3.0:1790391612.527424:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391612.527856:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169652992 00000100:00100000:0.0:1790391612.527867:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169652992 00000100:00100000:0.0:1790391612.527948:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 135 00000100:00100000:0.0:1790391612.527957:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+11:15038:x1877361169652992:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391612.528102:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+11:15038:x1877361169652992:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 146us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391612.528110:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 135 00000100:00100000:1.0:1790391612.530733:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.531111:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169653120 00000100:00100000:2.0:1790391612.531122:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169653120 00000100:00100000:2.0:1790391612.531178:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 136 00000100:00100000:2.0:1790391612.531188:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+11:15038:x1877361169653120:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391612.531441:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51839a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+11:15038:x1877361169653120:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 253us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.531449:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 136 00000100:00100000:1.0:1790391612.550538:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391612.550612:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169653248 00000100:00100000:3.0:1790391612.550621:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169653248 00000100:00100000:3.0:1790391612.550680:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 137 00000100:00100000:3.0:1790391612.550690:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+11:15034:x1877361169653248:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790391612.550706:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391612.550722:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e25c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b058a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391612.550748:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e25c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b058a expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391612.550758:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280031800/0x2b1b7949f13e25c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b058a expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391612.550765:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031800, rc 0) 00000100:00100000:3.0:1790391612.550815:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+12:15034:x1877361169653248:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 126us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391612.550827:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 137 00000100:00100000:3.0:1790391612.554174:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391612.554236:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169653376 00000100:00100000:0.0:1790391612.554247:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169653376 00000100:00100000:0.0:1790391612.554305:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 138 00000100:00100000:0.0:1790391612.554316:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+12:15034:x1877361169653376:12345-192.168.202.28@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790391612.554461:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790391612.554487:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790391612.554492:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790391612.554495:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790391612.554497:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1790391612.554500:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1790391612.557797:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+12:15034:x1877361169653376:12345-192.168.202.28@tcp:256:mount.lustre.0 Request processed in 3467us (3615us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391612.557813:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 138 00000100:00100000:1.0:1790391612.561750:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.561842:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169653504 00000100:00100000:2.0:1790391612.561852:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169653504 00000100:00100000:2.0:1790391612.561930:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 139 00000100:00100000:2.0:1790391612.561940:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+12:15034:x1877361169653504:12345-192.168.202.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790391612.561956:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391612.561973:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e518309ce00/0x2b1b7949f13e25c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0591 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391612.562008:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309ce00/0x2b1b7949f13e25c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0591 expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391612.562037:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e518309ce00/0x2b1b7949f13e25c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0591 expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391612.562047:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ce00, rc 0) 00000100:00100000:2.0:1790391612.562099:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:15034:x1877361169653504:12345-192.168.202.28@tcp:101:mount.lustre.0 Request processed in 161us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.562106:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 139 00000100:00100000:3.0:1790391612.566367:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391612.566524:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169653632 00000100:00100000:0.0:1790391612.566535:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169653632 00000100:00100000:0.0:1790391612.566590:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 140 00000100:00100000:0.0:1790391612.566600:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+13:15034:x1877361169653632:12345-192.168.202.28@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790391612.566784:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+13:15034:x1877361169653632:12345-192.168.202.28@tcp:501:mount.lustre.0 Request processed in 184us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391612.566792:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 140 00000100:00100000:1.0:1790391612.571251:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391612.571357:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169653760 00000100:00100000:3.0:1790391612.571369:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169653760 00000100:00100000:3.0:1790391612.571427:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 141 00000100:00100000:3.0:1790391612.571452:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+13:15034:x1877361169653760:12345-192.168.202.28@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790391612.571600:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+13:15034:x1877361169653760:12345-192.168.202.28@tcp:503:mount.lustre.0 Request processed in 151us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391612.571608:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 141 00000100:00100000:1.0:1790391612.575579:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.575795:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169653888 00000100:00100000:2.0:1790391612.575806:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169653888 00000100:00100000:2.0:1790391612.575866:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 142 00000100:00100000:2.0:1790391612.575895:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:15042:x1877361169653888:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790391612.576070:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:15042:x1877361169653888:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 195us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.576079:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 142 00000100:00100000:1.0:1790391612.587663:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391612.587786:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169654016 00000100:00100000:0.0:1790391612.587798:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169654016 00000100:00100000:0.0:1790391612.587868:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 143 00000100:00100000:0.0:1790391612.587913:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+13:15042:x1877361169654016:12345-192.168.202.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790391612.588092:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+13:15042:x1877361169654016:12345-192.168.202.28@tcp:502:llog_process_th.0 Request processed in 214us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391612.588100:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 143 00000100:00100000:1.0:1790391612.602132:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391612.602177:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391612.602267:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169654144 00000100:00100000:3.0:1790391612.602279:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169654144 00000100:00100000:2.0:1790391612.602297:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169654400 00000100:00100000:2.0:1790391612.602304:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169654400 00000100:00100000:3.0:1790391612.602350:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:3.0:1790391612.602361:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2380:x1877361169654144:12345-192.168.202.28@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790391612.602394:0:17201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 957e4510-6da1-45ee-bf96-cb07984ae4a9@192.168.202.28@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:3.0:1790391612.602435:0:17201:0:(genops.c:1385:class_connect()) connect: client 957e4510-6da1-45ee-bf96-cb07984ae4a9, cookie 0x2b1b7949f13e25d0 00000004:00100000:3.0:1790391612.602461:0:17201:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790391612.602567:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9e51810c7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391612.602651:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2380:x1877361169654144:12345-192.168.202.28@tcp:38:mount.lustre.0 Request processed in 291us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391612.602659:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:3.0:1790391612.602677:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:3.0:1790391612.602682:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2380:x1877361169654400:12345-192.168.202.28@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790391612.602696:0:17201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 957e4510-6da1-45ee-bf96-cb07984ae4a9@192.168.202.28@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:3.0:1790391612.602736:0:17201:0:(genops.c:1385:class_connect()) connect: client 957e4510-6da1-45ee-bf96-cb07984ae4a9, cookie 0x2b1b7949f13e25d7 00000004:00100000:3.0:1790391612.602759:0:17201:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790391612.602816:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9e51810c0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391612.602843:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2380:x1877361169654400:12345-192.168.202.28@tcp:38:mount.lustre.0 Request processed in 159us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391612.602850:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:1.0:1790391612.614596:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391612.614635:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391612.614682:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.614735:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169654528 00000100:00100000:2.0:1790391612.614747:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169654528 00000100:00100000:0.0:1790391612.614787:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169654656 00000100:00100000:0.0:1790391612.614793:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169654656 00000100:00100000:2.0:1790391612.614819:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169654272 00000100:00100000:2.0:1790391612.614824:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169654272 00000100:00100000:0.0:1790391612.614829:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:0.0:1790391612.614841:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:0:x1877361169654528:12345-192.168.202.28@tcp:41:mount.lustre.0 00000100:00080000:1.0:1790391612.614895:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391612.614900:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1790391612.614907:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790391612.614994:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:0:x1877361169654528:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 155us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391612.615002:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 18 00000100:00100000:0.0:1790391612.615017:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:0.0:1790391612.615023:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+7:15034:x1877361169654656:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391612.615046:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790391612.615074:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+7:15034:x1877361169654656:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 51us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391612.615080:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:0.0:1790391612.615096:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:0.0:1790391612.615102:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:0:x1877361169654272:12345-192.168.202.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790391612.615111:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790391612.615129:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:0:x1877361169654272:12345-192.168.202.28@tcp:41:mount.lustre.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391612.615135:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:0.0:1790391612.630681:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.631307:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169654784 00000100:00100000:2.0:1790391612.631318:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169654784 00000100:00100000:2.0:1790391612.631393:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:2.0:1790391612.631403:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:15034:x1877361169654784:12345-192.168.202.28@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790391612.631502:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:15034:x1877361169654784:12345-192.168.202.28@tcp:40:mount.lustre.0 Request processed in 100us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.631527:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391612.634103:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391612.634873:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169654912 00000100:00100000:3.0:1790391612.634945:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169654912 00000100:00100000:3.0:1790391612.635209:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:3.0:1790391612.635218:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2380:x1877361169654912:12345-192.168.202.28@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790391612.635255:0:18709:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 957e4510-6da1-45ee-bf96-cb07984ae4a9@192.168.202.28@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:3.0:1790391612.635284:0:18709:0:(genops.c:1385:class_connect()) connect: client 957e4510-6da1-45ee-bf96-cb07984ae4a9, cookie 0x2b1b7949f13e25de 00002000:00100000:3.0:1790391612.635295:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 957e4510-6da1-45ee-bf96-cb07984ae4a9/ffff9e51810c1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790391612.635306:0:18709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790391612.635400:0:18709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790391612.635433:0:18709:0:(import.c:65:import_set_state_nolock()) ffff9e52878bd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790391612.635510:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2380:x1877361169654912:12345-192.168.202.28@tcp:8:mount.lustre.0 Request processed in 292us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391612.637167:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391612.637709:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391612.637786:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169655168 00000100:00100000:0.0:1790391612.637796:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169655168 00000100:00100000:0.0:1790391612.637902:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:0.0:1790391612.637913:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:15034:x1877361169655168:12345-192.168.202.28@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790391612.638177:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:15034:x1877361169655168:12345-192.168.202.28@tcp:900:mount.lustre.0 Request processed in 264us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391612.638185:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:0.0:1790391612.662158:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.662209:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169655040 00000100:00100000:2.0:1790391612.662219:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169655040 00000100:00100000:2.0:1790391612.662269:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:2.0:1790391612.662278:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2380:x1877361169655040:12345-192.168.202.28@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790391612.662315:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 957e4510-6da1-45ee-bf96-cb07984ae4a9@192.168.202.28@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1790391612.662358:0:18707:0:(genops.c:1385:class_connect()) connect: client 957e4510-6da1-45ee-bf96-cb07984ae4a9, cookie 0x2b1b7949f13e25e5 00002000:00100000:2.0:1790391612.662371:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 957e4510-6da1-45ee-bf96-cb07984ae4a9/ffff9e51838d1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790391612.662390:0:18707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790391612.662483:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790391612.662513:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9e5182096000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790391612.662591:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2380:x1877361169655040:12345-192.168.202.28@tcp:8:mount.lustre.0 Request processed in 312us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.662599:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:0.0:1790391612.669604:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391612.669842:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169655296 00000100:00100000:2.0:1790391612.669853:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169655296 00000100:00100000:2.0:1790391612.669942:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:2.0:1790391612.669953:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:15034:x1877361169655296:12345-192.168.202.28@tcp:33:mount.lustre.0 00000004:00200000:2.0:1790391612.670062:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790391612.670156:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:15034:x1877361169655296:12345-192.168.202.28@tcp:33:mount.lustre.0 Request processed in 205us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.670164:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:1.0:1790391612.888484:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391612.897891:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169655424 00000100:00100000:3.0:1790391612.897911:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169655424 00000100:00100000:3.0:1790391612.897996:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:3.0:1790391612.898007:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:15065:x1877361169655424:12345-192.168.202.28@tcp:101:mkdir.0 00010000:00010000:3.0:1790391612.898028:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391612.898048:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e25ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b05c2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391612.898120:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391612.898133:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391612.898166:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391612.898213:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790391612.898217:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391612.898235:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391612.898260:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031600/0x2b1b7949f13e25ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c2 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391612.898278:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c2 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391612.898286:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bba00) 00010000:00010000:3.0:1790391612.898289:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790391612.898293:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280030200, rc 0) 00000100:00100000:3.0:1790391612.901378:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+7:15065:x1877361169655424:12345-192.168.202.28@tcp:101:mkdir.0 Request processed in 3357us (12891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391612.901392:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:1.0:1790391612.936187:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391612.936217:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186517376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391612.936301:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391612.936698:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391612.936890:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186517376 00000100:00100000:0.0:1790391612.936899:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186517376 00000100:00100000:0.0:1790391612.937012:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391612.937021:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186517376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790391612.937048:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790391612.937106:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186517376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391612.937112:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790391612.937169:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186517376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790391612.938347:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790391612.938367:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186517504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790391612.938428:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391612.938516:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186517504 00000100:00100000:2.0:1790391612.938534:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186517504 00000100:00080000:1.0:1790391612.938755:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790391612.938903:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790391612.938913:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186517504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391612.938933:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790391612.938993:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186517504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391612.939000:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790391612.939081:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186517504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391613.448091:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790391613.448123:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186517632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391613.448196:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391613.448246:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186517760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391613.448281:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391613.448303:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186517632 00000100:00100000:2.0:1790391613.448312:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186517632 00000100:00100000:1.0:1790391613.448366:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186517760 00000100:00100000:1.0:1790391613.448372:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186517760 00000100:00100000:2.0:1790391613.448387:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790391613.448399:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186517632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790391613.448436:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790391613.450250:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186517632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1841us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391613.450861:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790391613.450929:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391613.450946:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186517760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391613.450986:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790391613.451058:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186517760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391613.451065:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790391613.452101:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186517760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790391613.454540:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186517632:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790391613.968790:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790391614.358072:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790391614.984266:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790391615.502551:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 957e4510-6da1-45ee-bf96-cb07984ae4a9 00000001:00100000:2.0:1790391615.502568:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000001:00100000:1.0:1790391615.502929:0:17182:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 957e4510-6da1-45ee-bf96-cb07984ae4a9 00000001:00100000:1.0:1790391615.502938:0:17182:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000001:00100000:2.0:1790391615.506625:0:17934:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 957e4510-6da1-45ee-bf96-cb07984ae4a9 00000001:00100000:2.0:1790391615.506644:0:17934:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 89b7dd42-ca89-4c21-9061-6e0347f78f2b 00000001:02000400:2.0:1790391615.896212:0:20077:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1790391616.009699:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186517888:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.009777:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.009824:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186518400:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.009850:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.009870:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186518912:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.009911:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.009930:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186519424:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.009949:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.009974:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790391616.009980:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186518272:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010006:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.010024:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186518784:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010066:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.010083:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186519296:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.010128:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186518144:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.010166:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186518656:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010185:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.010201:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186519168:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010220:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.010233:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790391616.010238:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186518016:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010259:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.010277:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186518528:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010478:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.010496:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186519040:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010516:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.010541:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186517888 00000100:00100000:1.0:1790391616.010549:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186517888 00000100:00100000:1.0:1790391616.010596:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790391616.010605:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3638:x1877361186517888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010653:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5282b66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3638:x1877361186517888:12345-0@lo:400:kworker.0 Request processed in 49us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.010659:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790391616.010690:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186518400 00000100:00100000:1.0:1790391616.010694:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186518400 00000100:00100000:1.0:1790391616.010721:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186518912 00000100:00100000:1.0:1790391616.010725:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186518912 00000100:00100000:1.0:1790391616.010735:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186519424 00000100:00100000:1.0:1790391616.010737:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186519424 00000100:00100000:1.0:1790391616.010758:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186519296 00000100:00100000:1.0:1790391616.010760:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186519296 00000100:00100000:1.0:1790391616.010771:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186519168 00000100:00100000:1.0:1790391616.010774:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186519168 00000100:00100000:1.0:1790391616.010785:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186519040 00000100:00100000:1.0:1790391616.010787:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186519040 00000100:00100000:1.0:1790391616.010801:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391616.010806:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186518400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010837:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186518400:12345-0@lo:400:kworker.0 Request processed in 31us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.010844:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790391616.010856:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790391616.010861:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186518912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010910:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877361186518912:12345-0@lo:400:kworker.0 Request processed in 49us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.010916:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790391616.010927:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790391616.010933:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186519424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.010957:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877361186519424:12345-0@lo:400:kworker.0 Request processed in 25us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.010964:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790391616.010974:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790391616.010980:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186519296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.011005:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877361186519296:12345-0@lo:400:kworker.0 Request processed in 26us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.011018:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790391616.011030:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790391616.011035:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186519168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.011066:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186519168:12345-0@lo:400:kworker.0 Request processed in 31us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.011072:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790391616.011083:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790391616.011089:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186519040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.011112:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877361186519040:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.011117:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790391616.011141:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186518272 00000100:00100000:1.0:1790391616.011145:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186518272 00000100:00100000:1.0:1790391616.011162:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186518784 00000100:00100000:1.0:1790391616.011164:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186518784 00000100:00100000:1.0:1790391616.011174:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186518144 00000100:00100000:1.0:1790391616.011176:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186518144 00000100:00100000:1.0:1790391616.011185:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186518656 00000100:00100000:1.0:1790391616.011187:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186518656 00000100:00100000:1.0:1790391616.011198:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790391616.011203:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186518272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.011231:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186518272:12345-0@lo:400:kworker.0 Request processed in 27us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.011236:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790391616.011247:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391616.011251:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186518784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.016071:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186518784:12345-0@lo:400:kworker.0 Request processed in 4807us (5992us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.016087:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790391616.016121:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391616.016134:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186518144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.016202:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186518144:12345-0@lo:400:kworker.0 Request processed in 74us (6052us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.016208:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790391616.016221:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391616.016227:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186518656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.016255:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186518656:12345-0@lo:400:kworker.0 Request processed in 28us (6069us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.016260:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790391616.016731:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186518016 00000100:00100000:1.0:1790391616.016742:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186518016 00000100:00100000:1.0:1790391616.016836:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186518528 00000100:00100000:1.0:1790391616.016840:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186518528 00000100:00100000:0.0:1790391616.018009:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790391616.018024:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186518016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391616.018102:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186518016:12345-0@lo:400:kworker.0 Request processed in 81us (7840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391616.018109:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790391616.018129:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790391616.018135:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186518528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391616.018164:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186518528:12345-0@lo:400:kworker.0 Request processed in 30us (7686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391616.018169:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790391616.019714:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1790391616.019744:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186518272:0@lo:400:kworker.0 00000100:00100000:0.0:1790391616.019764:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186518784:0@lo:400:kworker.0 00000100:00100000:0.0:1790391616.019784:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1877361186519296:0@lo:400:kworker.0 00000100:00100000:0.0:1790391616.019794:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186517888:0@lo:400:kworker.0 00000100:00100000:0.0:1790391616.019806:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186518400:0@lo:400:kworker.0 00000100:00100000:0.0:1790391616.019815:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877361186518912:0@lo:400:kworker.0 00010000:00080000:0.0:1790391616.019857:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e52849bb100 x1877361186519424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790391616.019868:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1877361186519424:0@lo:400:kworker.0 00000100:00080000:1.0:1790391616.021018:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391616.021027:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391616.021031:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391616.021033:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391616.021054:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186519680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391616.021120:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.021166:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186518016:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.021177:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186518528:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.021189:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1877361186519040:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.021216:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186518144:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.021227:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186518656:0@lo:400:kworker.0 00010000:00080000:1.0:1790391616.021240:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518229e680 x1877361186519168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391616.021251:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186519168:0@lo:400:kworker.0 00000100:00100000:1.0:1790391616.021277:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391616.021293:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186519552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391616.021329:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391616.021363:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186519680 00000100:00100000:1.0:1790391616.021369:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186519680 00000100:00100000:1.0:1790391616.021404:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186519552 00000100:00100000:1.0:1790391616.021407:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186519552 00000100:00100000:1.0:1790391616.021419:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391616.021427:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186519680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790391616.021456:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391616.021496:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186519680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.021503:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790391616.021518:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391616.021523:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186519552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391616.021533:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391616.021554:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186519552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391616.021560:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790391616.021588:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186519552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391616.021608:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186519680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790391616.023461:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790391617.032607:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391617.942757:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391617.946335:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169655680 00000100:00100000:0.0:1790391617.946351:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169655680 00000100:00080000:2.0:1790391617.946475:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391617.946481:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:0.0:1790391617.946492:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:2381:x1877361169655680:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391617.946584:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:2381:x1877361169655680:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 94us (3841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391617.946591:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:0.0:1790391617.946761:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391617.946977:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391617.946996:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391617.947040:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169656192 00000100:00100000:2.0:1790391617.947046:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169656192 00000100:00100000:2.0:1790391617.947082:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00100000:2.0:1790391617.947090:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2381:x1877361169656192:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391617.947128:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2381:x1877361169656192:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391617.947135:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00080000:2.0:1790391617.947151:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391617.947165:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391617.947500:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169655936 00000100:00100000:3.0:1790391617.947511:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169655936 00000100:00100000:3.0:1790391617.947548:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169656448 00000100:00100000:3.0:1790391617.947551:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169656448 00000100:00100000:3.0:1790391617.947569:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:3.0:1790391617.947575:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2381:x1877361169655936:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391617.947809:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2381:x1877361169655936:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 29us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391617.947817:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:3.0:1790391617.947832:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:3.0:1790391617.947838:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2381:x1877361169656448:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:3.0:1790391617.947865:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2381:x1877361169656448:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 28us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391617.947901:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00080000:3.0:1790391617.948072:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790391617.948328:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391617.948390:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391617.948415:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391617.948434:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391617.948453:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169656064 00000100:00100000:0.0:1790391617.948458:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169656064 00000100:00100000:0.0:1790391617.948482:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169656576 00000100:00100000:0.0:1790391617.948484:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169656576 00000100:00100000:0.0:1790391617.948496:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:0.0:1790391617.948502:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2381:x1877361169656064:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391617.948534:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2381:x1877361169656064:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 32us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391617.948549:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:0.0:1790391617.948562:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:0.0:1790391617.948568:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2381:x1877361169656576:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391617.948587:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2381:x1877361169656576:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 20us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391617.948593:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:0.0:1790391617.948831:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169655808 00000100:00100000:0.0:1790391617.948835:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169655808 00000100:00100000:0.0:1790391617.948857:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169656320 00000100:00100000:0.0:1790391617.948859:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169656320 00000100:00100000:0.0:1790391617.948872:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:0.0:1790391617.948962:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2381:x1877361169655808:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391617.948994:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2381:x1877361169655808:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 91us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391617.949001:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:0.0:1790391617.949013:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:0.0:1790391617.949019:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2381:x1877361169656320:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391617.949042:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2381:x1877361169656320:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391617.949047:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00080000:3.0:1790391617.949462:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790391617.949466:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790391617.952237:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169655552 00000100:00100000:2.0:1790391617.952252:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169655552 00000100:00100000:2.0:1790391617.952328:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 145 00000100:00100000:2.0:1790391617.952340:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:2381:x1877361169655552:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:2.0:1790391617.952435:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:2381:x1877361169655552:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 97us (5269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391617.952442:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 145 00010000:00010000:0.0:1790391618.060966:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391618.061161:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790391618.061185:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186519808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391618.061255:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391618.061310:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186519808 00000100:00100000:1.0:1790391618.061317:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186519808 00000100:00100000:1.0:1790391618.061368:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391618.061377:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186519808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790391618.061405:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790391618.061450:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186519808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391618.061457:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1790391618.061477:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391618.061512:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186519808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391618.061785:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186519936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391618.061812:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391618.062117:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186519936 00000100:00100000:3.0:1790391618.062122:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186519936 00000100:00100000:3.0:1790391618.062162:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790391618.062169:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186519936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790391618.062183:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790391618.062218:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186519936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391618.062224:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790391618.062411:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790391618.062438:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186519936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790391618.568209:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186520064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391618.568299:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391618.568826:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186520064 00000100:00100000:2.0:1790391618.568837:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186520064 00000100:00100000:2.0:1790391618.568922:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391618.568932:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186520064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790391618.568967:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790391618.569187:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186520064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 256us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391618.569201:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391618.569955:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186520192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790391618.570011:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391618.570152:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186520192 00000100:00100000:1.0:1790391618.570159:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186520192 00000100:00100000:1.0:1790391618.570202:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790391618.570210:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186520192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391618.570235:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790391618.570278:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186520192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391618.570307:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790391618.570352:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186520192:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1790391618.577718:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 957e4510-6da1-45ee-bf96-cb07984ae4a9 00000100:00100000:0.0:1790391618.578077:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186520064:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790391619.080098:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790391619.439839:0:20224:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee4e774d0 20000000:00000080:0.0:1790391619.439861:0:20224:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e52878d2c00 uarg=0000000000000000 20000000:01000000:0.0:1790391619.439961:0:20224:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790391619.439968:0:20224:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790391619.440100:0:20224:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790391619.440664:0:20225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1790391619.440839:0:20224:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790391619.446621:0:20224:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790391619.446658:0:20224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.446679:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e228f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2288 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.446688:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e229d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2296 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.446695:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e22dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e22d5 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.446703:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e5183087200/0x2b1b7949f13e243a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2433 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.446713:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e518309ca00/0x2b1b7949f13e258a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0521 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.446721:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e518309ce00/0x2b1b7949f13e25c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0591 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.446730:0:20224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.446798:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e518309ce00/0x2b1b7949f13e25c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0591 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.446815:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e518309ce00/0x2b1b7949f13e25c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0591 expref: 12 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391619.446831:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520320:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391619.447194:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e518309ca00/0x2b1b7949f13e258a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0521 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.447204:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e518309ca00/0x2b1b7949f13e258a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0521 expref: 12 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391619.447214:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520448:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391619.447248:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5183087200/0x2b1b7949f13e243a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2433 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.447257:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5183087200/0x2b1b7949f13e243a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2433 expref: 23 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391619.447267:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520576:0@lo:104: 00000100:00100000:2.0:1790391619.447321:0:20224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391619.447377:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e22dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e22d5 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391619.447378:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186520576 00000100:00100000:3.0:1790391619.447387:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186520576 00010000:00010000:2.0:1790391619.447391:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e22dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e22d5 expref: 23 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391619.447415:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520704:0@lo:104: 00000100:00100000:2.0:1790391619.447441:0:20224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391619.447446:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1790391619.447462:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e229d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2296 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391619.447467:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:20224:x1877361186520576:12345-0@lo:104: 00010000:00010000:2.0:1790391619.447476:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e229d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2296 expref: 23 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.447486:0:17186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391619.447488:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520832:0@lo:104: 00000100:00100000:2.0:1790391619.447517:0:20224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790391619.447541:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e228f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2b1b7949f13e2288 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.447551:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e228f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2b1b7949f13e2288 expref: 23 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.447552:0:17186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790391619.447562:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:20224:x1877361186520576:12345-0@lo:104: Request processed in 99us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391619.447567:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520960:0@lo:104: 00000100:00100000:3.0:1790391619.447573:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790391619.447591:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186520704 00000100:00100000:3.0:1790391619.447594:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186520704 00000100:00100000:3.0:1790391619.447610:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186520832 00000100:00100000:3.0:1790391619.447613:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186520832 00000100:00100000:2.0:1790391619.447617:0:20224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391619.447629:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186520960 00000100:00100000:2.0:1790391619.447633:0:20224:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5183254600 going to sleep for 11 seconds 00000100:00100000:3.0:1790391619.447634:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186520960 00000100:00100000:3.0:1790391619.447652:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391619.447659:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+5:20224:x1877361186520704:12345-0@lo:104: 00000100:00100000:2.0:1790391619.447665:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520576:0@lo:104: 00010000:00010000:3.0:1790391619.447668:0:17186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.447712:0:17186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790391619.447718:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+5:20224:x1877361186520704:12345-0@lo:104: Request processed in 60us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391619.447720:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520704:0@lo:104: 00000100:00100000:3.0:1790391619.447729:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790391619.447744:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391619.447750:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+4:20224:x1877361186520832:12345-0@lo:104: 00010000:00010000:3.0:1790391619.447770:0:17186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.447822:0:17186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790391619.447833:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+4:20224:x1877361186520832:12345-0@lo:104: Request processed in 83us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391619.447840:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391619.447853:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391619.447859:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:20224:x1877361186520960:12345-0@lo:104: 00010000:00010000:3.0:1790391619.447868:0:17186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.447941:0:17186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790391619.447945:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+3:20224:x1877361186520960:12345-0@lo:104: Request processed in 88us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391619.447951:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1790391619.447970:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790391619.447976:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.447983:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087c00 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391619.447987:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.447995:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391619.448002:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391619.448007:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790391619.448033:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448050:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391619.448072:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448084:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5183087c00/0x2b1b7949f13e2433 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e243a expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448097:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790391619.448100:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448106:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054200 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391619.448109:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448116:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391619.448122:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391619.448127:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790391619.448150:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448157:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391619.448164:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448170:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5184054200/0x2b1b7949f13e22d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e22dc expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448190:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790391619.448193:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448199:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184054600 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391619.448202:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448210:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391619.448216:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391619.448222:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790391619.448237:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448243:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391619.448260:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448267:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e5184054600/0x2b1b7949f13e2296 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e229d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448292:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790391619.448296:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448312:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52b5eef200 already unused, calling callback (ffffffffc124dc20) 10000000:00010000:3.0:1790391619.448316:0:17191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448324:0:17191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790391619.448331:0:17191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391619.448336:0:17191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790391619.448351:0:17191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448358:0:17191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790391619.448366:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.448373:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.128@tcp lock: ffff9e52b5eef200/0x2b1b7949f13e2288 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2b1b7949f13e228f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391619.448381:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391619.448390:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391619.448393:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790391619.448394:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790391619.448404:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186521088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391619.448417:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186521216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391619.448445:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391619.448459:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186521472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790391619.448487:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391619.448493:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186521344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391619.448530:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391619.448578:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186521088 00000100:00100000:0.0:1790391619.448583:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186521088 00010000:00010000:0.0:1790391619.448604:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5183087200/0x2b1b7949f13e243a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2433 expref: 24 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391619.448627:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186521472 00000100:00100000:0.0:1790391619.448630:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186521472 00010000:00010000:0.0:1790391619.448646:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e228f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2288 expref: 25 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391619.448656:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186521344 00000100:00100000:0.0:1790391619.448659:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186521344 00010000:00010000:0.0:1790391619.448667:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e229d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2296 expref: 26 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391619.448677:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391619.448682:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+26:3637:x1877361186521088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391619.448691:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391619.448700:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5183087200/0x2b1b7949f13e243a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2433 expref: 26 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391619.448708:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5183087200/0x2b1b7949f13e243a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2433 expref: 26 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391619.448719:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5183087200/0x2b1b7949f13e243a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2433 expref: 26 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391619.448730:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391619.448757:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+25:3637:x1877361186521088:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391619.448763:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790391619.448776:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391619.448782:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3640:x1877361186521472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391619.448797:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391619.448801:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e228f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2288 expref: 24 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391619.448809:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e228f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2288 expref: 24 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391619.448818:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391619.448848:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3640:x1877361186521472:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391619.448853:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790391619.448871:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790391619.448902:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:3639:x1877361186521344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790391619.448909:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391619.448917:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e229d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e2296 expref: 23 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391619.448928:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e229d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e2296 expref: 23 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391619.448938:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391619.449178:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184055200/0x2b1b7949f13e229d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2296 expref: 23 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391619.449202:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520832:0@lo:104: 00010000:00010000:2.0:1790391619.449213:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e5184054c00/0x2b1b7949f13e228f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e2288 expref: 22 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391619.449242:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520960:0@lo:104: 00000100:00100000:2.0:1790391619.453170:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391619.453367:0:17188:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790391619.453390:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1790391619.453450:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3639:1877361186521344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790391619.453545:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391619.453559:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:3639:x1877361186521344:12345-0@lo:103:ldlm_bl.0 Request processed in 4681us (5027us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391619.453577:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790391619.453596:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186521216 00000100:00100000:3.0:1790391619.453605:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186521216 00010000:00010000:3.0:1790391619.453640:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e22dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e22d5 expref: 21 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391619.453662:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391619.453664:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169656704 00000100:00100000:3.0:1790391619.453668:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169656704 00010000:00010000:3.0:1790391619.453684:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e518309ce00/0x2b1b7949f13e25c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0591 expref: 13 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391619.453696:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169656832 00000100:00100000:3.0:1790391619.453698:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169656832 00010000:00010000:3.0:1790391619.453711:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e518309ca00/0x2b1b7949f13e258a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0521 expref: 14 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391619.453727:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391619.453736:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:3638:x1877361186521216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790391619.453749:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391619.453755:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e22dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2b1b7949f13e22d5 expref: 21 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.453767:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e22dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2b1b7949f13e22d5 expref: 21 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.453786:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e52b763d600/0x2b1b7949f13e22dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2b1b7949f13e22d5 expref: 21 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391619.453837:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186521088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391619.453863:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3640:1877361186521472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790391619.453946:0:17189:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790391619.453956:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:0.0:1790391619.453963:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de820afa-b30f-4af2-bd45-eaefa881a982+14:2383:x1877361169656704:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391619.453971:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391619.454302:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391619.454334:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e518309ce00/0x2b1b7949f13e25c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0591 expref: 14 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391619.454349:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e518309ce00/0x2b1b7949f13e25c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0591 expref: 14 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391619.454360:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391619.454403:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de820afa-b30f-4af2-bd45-eaefa881a982+14:2383:x1877361169656704:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 440us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391619.454412:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:3638:x1877361186521216:12345-0@lo:103:ldlm_bl.0 Request processed in 676us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391619.454420:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 13 00000100:00100000:3.0:1790391619.454437:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790391619.454485:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 14 00000100:00100000:3.0:1790391619.454494:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52849bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de820afa-b30f-4af2-bd45-eaefa881a982+13:2383:x1877361169656832:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391619.454503:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391619.454508:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e518309ca00/0x2b1b7949f13e258a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0521 expref: 13 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.454518:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e518309ca00/0x2b1b7949f13e258a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0521 expref: 13 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.454530:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.454540:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391619.454615:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186521216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790391619.455222:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309ce00/0x2b1b7949f13e25c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0591 expref: 13 pid: 17194 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391619.455237:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520320:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391619.455249:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309ca00/0x2b1b7949f13e258a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0521 expref: 12 pid: 17196 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391619.455257:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1877361186520448:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391619.455457:0:17187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.455467:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.455474:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.455482:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.455488:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309da00 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:3.0:1790391619.455493:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.455512:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.455517:0:20224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.455524:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.455530:0:20224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391619.455534:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391619.455539:0:20224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391619.455548:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e518309da00/0x2b1b7949f13e25fa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391619.455951:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52849bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de820afa-b30f-4af2-bd45-eaefa881a982+11:2383:x1877361169656832:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 1455us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391619.455961:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 14 00000040:00080000:1.0:1790391619.656569:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790391620.105396:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391620.999317:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391620.999556:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169656960 00000100:00100000:0.0:1790391620.999566:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169656960 00000100:00100000:0.0:1790391620.999674:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 146 00000100:00100000:0.0:1790391620.999685:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+11:14912:x1877361169656960:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391620.999706:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391620.999726:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144800/0x2b1b7949f13e2601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b05c9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391620.999755:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144800/0x2b1b7949f13e2601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c9 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391620.999766:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144800/0x2b1b7949f13e2601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c9 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391620.999775:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144800, rc 0) 00000100:00100000:0.0:1790391620.999836:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+12:14912:x1877361169656960:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 Request processed in 153us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391620.999848:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 146 00000100:00100000:0.0:1790391621.002676:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391621.002787:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169657088 00000100:00100000:1.0:1790391621.002798:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169657088 00000100:00100000:1.0:1790391621.003058:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 147 00000100:00100000:1.0:1790391621.003069:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+12:14912:x1877361169657088:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790391621.003228:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+12:14912:x1877361169657088:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 Request processed in 152us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391621.003236:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 147 00000100:00100000:1.0:1790391621.006308:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391621.010580:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169657216 00000100:00100000:0.0:1790391621.010597:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169657216 00000100:00100000:1.0:1790391621.011409:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 148 00000100:00100000:1.0:1790391621.011421:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+12:14912:x1877361169657216:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391621.011596:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+12:14912:x1877361169657216:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 Request processed in 177us (5299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391621.011606:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 148 00000100:00100000:0.0:1790391621.016284:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391621.022644:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169657344 00000100:00100000:1.0:1790391621.022664:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169657344 00000100:00100000:1.0:1790391621.022738:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 149 00000100:00100000:1.0:1790391621.022762:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+12:14912:x1877361169657344:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790391621.022780:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391621.022798:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e2608 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b05d0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391621.022843:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e2608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05d0 expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391621.022855:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5183087000/0x2b1b7949f13e2608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05d0 expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391621.022865:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087000, rc 0) 00000100:00100000:1.0:1790391621.023227:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+13:14912:x1877361169657344:12345-192.168.202.28@tcp:101:ll_cfg_requeue.0 Request processed in 466us (6962us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391621.023235:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 149 00000100:00100000:0.0:1790391621.034588:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391621.034679:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169657472 00000100:00100000:2.0:1790391621.034689:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169657472 00000100:00100000:2.0:1790391621.034742:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 150 00000100:00100000:2.0:1790391621.034751:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:14912:x1877361169657472:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391621.034930:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de820afa-b30f-4af2-bd45-eaefa881a982+13:14912:x1877361169657472:12345-192.168.202.28@tcp:501:ll_cfg_requeue.0 Request processed in 179us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391621.034937:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 150 00000100:00100000:0.0:1790391621.040872:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391621.040956:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169657600 00000100:00100000:1.0:1790391621.040967:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169657600 00000100:00100000:1.0:1790391621.041288:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 151 00000100:00100000:1.0:1790391621.041300:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+13:14912:x1877361169657600:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790391621.041475:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de820afa-b30f-4af2-bd45-eaefa881a982+13:14912:x1877361169657600:12345-192.168.202.28@tcp:503:ll_cfg_requeue.0 Request processed in 177us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391621.041484:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 151 00000100:00100000:1.0:1790391621.128049:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186521600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391621.128142:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391621.128177:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790391621.128183:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186522112:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.128237:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.128246:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186521984:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.128254:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186521728:0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.128285:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391621.128293:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.128303:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186522496:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.128319:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186522624:0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.128322:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.128336:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186523008:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.128341:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.128354:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391621.128357:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186523136:0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.128369:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790391621.128375:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186521856:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.128375:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391621.128389:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790391621.128394:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186522240:0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.128395:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.128410:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186522368:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.128412:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391621.128421:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186522752:0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.128427:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391621.128439:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.128441:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186522880:0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.128458:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391621.128468:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186521600 00000100:00100000:3.0:1790391621.128474:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186522112 00000100:00100000:1.0:1790391621.128475:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186521600 00000100:00100000:3.0:1790391621.128483:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186522112 00000100:00100000:3.0:1790391621.128521:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186521984 00000100:00100000:3.0:1790391621.128524:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186521984 00000100:00100000:1.0:1790391621.128525:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790391621.128532:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186521600:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790391621.128536:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186522496 00000100:00100000:3.0:1790391621.128538:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186522496 00000100:00100000:3.0:1790391621.128549:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790391621.128554:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186522112:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1790391621.128560:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391621.128742:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1877361186521600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 209us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391621.128750:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790391621.128773:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790391621.128780:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186521984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.128799:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1877361186522112:12345-0@lo:400:kworker.0 Request processed in 244us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.128806:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790391621.128812:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186521984:12345-0@lo:400:kworker.0 Request processed in 33us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391621.128818:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790391621.131374:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186521856 00000100:00100000:2.0:1790391621.131392:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186521856 00000100:00100000:2.0:1790391621.131441:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186522368 00000100:00100000:2.0:1790391621.131444:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186522368 00000100:00100000:2.0:1790391621.131460:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790391621.131469:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186521856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391621.131552:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186521856:12345-0@lo:400:kworker.0 Request processed in 84us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391621.131559:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790391621.131573:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790391621.131579:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186522368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391621.131601:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186522368:12345-0@lo:400:kworker.0 Request processed in 23us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391621.131606:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790391621.131626:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186522624 00000100:00100000:2.0:1790391621.131630:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186522624 00000100:00100000:2.0:1790391621.131648:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186523008 00000100:00100000:2.0:1790391621.131651:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186523008 00000100:00100000:2.0:1790391621.131664:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186523136 00000100:00100000:2.0:1790391621.131667:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186523136 00000100:00100000:2.0:1790391621.131678:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186522240 00000100:00100000:2.0:1790391621.131680:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186522240 00000100:00100000:2.0:1790391621.131691:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186522752 00000100:00100000:2.0:1790391621.131694:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186522752 00000100:00100000:2.0:1790391621.131705:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186522880 00000100:00100000:2.0:1790391621.131721:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186522880 00000100:00100000:2.0:1790391621.131738:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391621.131744:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186522624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391621.131777:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877361186522624:12345-0@lo:400:kworker.0 Request processed in 33us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391621.131784:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790391621.131796:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391621.131801:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186523008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391621.131826:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877361186523008:12345-0@lo:400:kworker.0 Request processed in 26us (3471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391621.131832:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790391621.131843:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391621.131849:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186523136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391621.131905:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877361186523136:12345-0@lo:400:kworker.0 Request processed in 27us (3499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391621.131912:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790391621.131925:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391621.131931:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186522240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391621.131959:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877361186522240:12345-0@lo:400:kworker.0 Request processed in 29us (3545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391621.131964:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790391621.131975:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790391621.131981:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186522752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391621.132007:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877361186522752:12345-0@lo:400:kworker.0 Request processed in 27us (3567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391621.132230:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790391621.132244:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790391621.132249:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186522880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391621.132288:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877361186522880:12345-0@lo:400:kworker.0 Request processed in 39us (3828us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391621.132293:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790391621.132366:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790391621.132377:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186522496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.132412:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186522496:12345-0@lo:400:kworker.0 Request processed in 38us (4089us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.132418:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1790391621.132444:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391621.132480:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186521856:0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.132493:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186522368:0@lo:400:kworker.0 00010000:00080000:3.0:1790391621.132506:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183290e00 x1877361186522880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790391621.132516:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1877361186522880:0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.132528:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186521984:0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.132537:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186522496:0@lo:400:kworker.0 00000100:00100000:3.0:1790391621.132547:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1877361186523008:0@lo:400:kworker.0 00000100:00080000:0.0:1790391621.139451:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790391621.139463:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391621.139467:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391621.139471:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790391621.139506:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186521728 00000100:00100000:0.0:1790391621.139519:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186521728 00000100:00100000:0.0:1790391621.139598:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790391621.139626:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:3637:x1877361186521728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790391621.139727:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:3637:x1877361186521728:12345-0@lo:400:kworker.0 Request processed in 104us (11433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391621.139735:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790391621.141539:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186523264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790391621.141610:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391621.141694:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877361186522240:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.141709:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1877361186522752:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.141723:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877361186522624:0@lo:400:kworker.0 00010000:00080000:1.0:1790391621.141737:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183292d80 x1877361186523136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391621.141748:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1877361186523136:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.141760:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1877361186522112:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.141771:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3637:1877361186521728:0@lo:400:kworker.0 00000100:00100000:1.0:1790391621.141792:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52849b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1877361186521600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790391621.141992:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186523264 00000100:00100000:0.0:1790391621.141998:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186523264 00000100:00100000:0.0:1790391621.142051:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790391621.142060:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186523264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391621.142081:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790391621.142126:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186523264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391621.142133:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790391621.142311:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186523264:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1790391621.259585:0:17199:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391621.259608:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52b5fb1000 from 13 10000000:01000000:3.0:1790391621.259622:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391621.259665:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.259677:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.259689:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391621.259713:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186523392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.259776:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.259816:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391621.259837:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186523392 00000100:00100000:3.0:1790391621.259844:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186523392 00000100:00100000:3.0:1790391621.259899:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790391621.259906:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52a0b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+20:17199:x1877361186523392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391621.259919:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391621.259932:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e2616 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e260f expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.259955:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e2616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e260f expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.259966:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280031600/0x2b1b7949f13e2616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e260f expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.259985:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280031600, rc 0) 00000100:00100000:3.0:1790391621.260017:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52a0b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:17199:x1877361186523392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.260029:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790391621.260076:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186523392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391621.260090:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.260098:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391621.260155:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186523520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.260178:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.260194:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391621.260204:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186523520 00000100:00100000:3.0:1790391621.260207:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186523520 00000100:00100000:3.0:1790391621.260224:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790391621.260229:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:17199:x1877361186523520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.260339:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:17199:x1877361186523520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.260346:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790391621.260370:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186523520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.260392:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186523648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.260426:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.260437:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790391621.260446:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186523648 00000100:00100000:3.0:1790391621.260449:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186523648 00000100:00100000:3.0:1790391621.260465:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790391621.260475:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:17199:x1877361186523648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.260534:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:17199:x1877361186523648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.260541:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790391621.260571:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186523648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790391621.261364:0:20299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790391621.261422:0:17199:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790391621.261437:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391621.261444:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.261454:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5280030000/0x2b1b7949f13e260f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2616 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391621.261463:0:17199:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391621.261465:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e52878bb800 from 13 10000000:01000000:3.0:1790391621.261467:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391621.261487:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.261495:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.261503:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391621.261516:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186523776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.261546:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.261573:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391621.261585:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186523776 00000100:00100000:3.0:1790391621.261589:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186523776 00000100:00100000:3.0:1790391621.261611:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790391621.261616:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+21:17199:x1877361186523776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391621.261624:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391621.261633:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e2624 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e261d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.261648:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e2624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e261d expref: 22 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.261656:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5280030e00/0x2b1b7949f13e2624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e261d expref: 22 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.261664:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5280030e00, rc 0) 00000100:00100000:3.0:1790391621.261687:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:17199:x1877361186523776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.261692:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790391621.261720:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186523776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391621.261729:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.261737:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391621.261771:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186523904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.261790:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.261805:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391621.261815:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186523904 00000100:00100000:3.0:1790391621.261818:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186523904 00000100:00100000:3.0:1790391621.261834:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790391621.261839:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:17199:x1877361186523904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.261922:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:17199:x1877361186523904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.261928:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790391621.261951:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186523904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.261969:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.261997:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.262012:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391621.262021:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186524032 00000100:00100000:3.0:1790391621.262024:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186524032 00000100:00100000:3.0:1790391621.262039:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790391621.262044:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:17199:x1877361186524032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.262097:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:17199:x1877361186524032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.262104:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790391621.262136:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790391621.275825:0:20300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790391621.276344:0:17199:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790391621.276376:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391621.276386:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.276398:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5280030400/0x2b1b7949f13e261d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2624 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391621.276418:0:17199:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391621.276421:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5288361800 from 13 10000000:01000000:3.0:1790391621.276423:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391621.276458:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.276466:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.276475:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391621.276498:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.276562:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.276599:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391621.276629:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186524160 00000100:00100000:3.0:1790391621.276635:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186524160 00000100:00100000:3.0:1790391621.276672:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790391621.276679:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+22:17199:x1877361186524160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391621.276691:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391621.276715:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e52bab9d400/0x2b1b7949f13e2632 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e262b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.276736:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e52bab9d400/0x2b1b7949f13e2632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e262b expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.276746:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e52bab9d400/0x2b1b7949f13e2632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e262b expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.276763:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9d400, rc 0) 00000100:00100000:3.0:1790391621.276794:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:17199:x1877361186524160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.276801:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790391621.276856:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391621.276869:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.276896:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391621.276943:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.276964:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.277141:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391621.277155:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186524288 00000100:00100000:3.0:1790391621.277159:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186524288 00000100:00100000:3.0:1790391621.277181:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790391621.277187:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:17199:x1877361186524288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.277292:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:17199:x1877361186524288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.277298:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790391621.277328:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.277354:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.277390:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.277408:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51822df780 going to sleep for 11 seconds 00000100:00100000:3.0:1790391621.277420:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186524416 00000100:00100000:3.0:1790391621.277424:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186524416 00000100:00100000:3.0:1790391621.277445:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790391621.277450:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:17199:x1877361186524416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.277518:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:17199:x1877361186524416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.277524:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790391621.277562:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790391621.284855:0:20303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790391621.285515:0:17199:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790391621.285537:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790391621.285548:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.285560:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e5280031e00/0x2b1b7949f13e262b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2632 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790391621.285571:0:17199:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790391621.285574:0:17199:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e5284dc3000 from 13 10000000:01000000:3.0:1790391621.285578:0:17199:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790391621.285617:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.285626:0:17199:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.285638:0:17199:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391621.285668:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.285762:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.285807:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da180 going to sleep for 11 seconds 00000100:00100000:0.0:1790391621.285860:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186524544 00000100:00100000:0.0:1790391621.285867:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186524544 00000100:00100000:0.0:1790391621.285937:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790391621.285957:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+23:17199:x1877361186524544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790391621.285969:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391621.286154:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2640 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1b7949f13e2639 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391621.286182:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2b1b7949f13e2639 expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391621.286193:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e5295144400/0x2b1b7949f13e2640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2b1b7949f13e2639 expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391621.286211:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144400, rc 0) 00000100:00100000:0.0:1790391621.286551:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:17199:x1877361186524544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 594us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391621.286558:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790391621.286753:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790391621.286770:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391621.286780:0:17199:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391621.286839:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.286868:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391621.287163:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da180 going to sleep for 11 seconds 00000100:00100000:2.0:1790391621.287204:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186524672 00000100:00100000:2.0:1790391621.287209:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186524672 00000100:00100000:2.0:1790391621.287245:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790391621.287252:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:17199:x1877361186524672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790391621.287487:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:17199:x1877361186524672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391621.287494:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790391621.289290:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183292300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790391621.289367:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790391621.289441:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391621.289491:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528916e900 going to sleep for 11 seconds 00000100:00100000:3.0:1790391621.289612:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186524800 00000100:00100000:3.0:1790391621.289619:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186524800 00000100:00100000:3.0:1790391621.289670:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790391621.289680:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:17199:x1877361186524800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790391621.289789:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:17199:x1877361186524800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391621.289796:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790391621.289918:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f157595d-6a80-4a0f-be35-35ee7e9fe29d:17199:1877361186524800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790391621.291281:0:20304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790391621.294145:0:17199:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790391621.294187:0:17199:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790391621.294198:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391621.294210:0:17199:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.128@tcp lock: ffff9e52bab9d600/0x2b1b7949f13e2639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2b1b7949f13e2640 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391622.152567:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391623.044222:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.044799:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169657728 00000100:00100000:2.0:1790391623.044811:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169657728 00000100:00100000:2.0:1790391623.044964:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:2.0:1790391623.044976:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:15582:x1877361169657728:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391623.044999:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391623.045024:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c000/0x2b1b7949f13e2647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b05d7 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045095:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d600/0x2b1b7949f13e264e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045110:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d600/0x2b1b7949f13e264e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045135:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d600/0x2b1b7949f13e264e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045152:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2655 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045159:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045166:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045259:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e265c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045267:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e265c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045273:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e265c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391623.045303:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790391623.045307:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391623.045346:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e265c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045370:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d600/0x2b1b7949f13e264e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045378:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d600/0x2b1b7949f13e264e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045396:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d600/0x2b1b7949f13e264e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045402:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391623.045407:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d600/0x2b1b7949f13e264e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045415:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d600/0x2b1b7949f13e264e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045427:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bba00) 00010000:00010000:2.0:1790391623.045430:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391623.045435:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d600/0x2b1b7949f13e264e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045442:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d600/0x2b1b7949f13e264e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045456:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045461:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2655 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045467:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2655 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045471:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ce00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391623.045474:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2655 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.045491:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2655 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.046732:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e52b9b6cf00) 00010000:00010000:2.0:1790391623.046736:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391623.046741:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2655 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.047591:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2655 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.047662:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c000/0x2b1b7949f13e2647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05d7 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.047678:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ca00/0x2b1b7949f13e265c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05d7 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.047686:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e52b9b6c800) 00010000:00010000:2.0:1790391623.047689:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391623.047692:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ca00, rc 0) 00000100:00100000:2.0:1790391623.048947:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:15582:x1877361169657728:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 3962us (4728us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.048970:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00080000:0.0:1790391623.050353:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790391623.052648:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.052765:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.052809:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.052843:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.052869:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.052914:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169657984 00000100:00100000:0.0:1790391623.052914:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.052926:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169657984 00000100:00100000:0.0:1790391623.052952:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.052973:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169658496 00000100:00100000:1.0:1790391623.052976:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169658496 00000100:00100000:1.0:1790391623.052988:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169658368 00000100:00100000:1.0:1790391623.052991:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169658368 00000100:00100000:1.0:1790391623.053006:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:1.0:1790391623.053015:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169657984:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391623.053015:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.053035:0:17202:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790391623.053042:0:17202:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1790391623.053055:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790391623.053059:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391623.053086:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169657984:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 73us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.053102:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:1.0:1790391623.053119:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:1.0:1790391623.053125:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169658496:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391623.053149:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169658496:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.053155:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:1.0:1790391623.053165:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:1.0:1790391623.053171:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2382:x1877361169658368:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391623.053192:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2382:x1877361169658368:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 22us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.053198:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:1.0:1790391623.053213:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169658240 00000100:00100000:1.0:1790391623.053216:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169658240 00000100:00100000:1.0:1790391623.053238:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169658752 00000100:00100000:1.0:1790391623.053241:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169658752 00000100:00100000:1.0:1790391623.053269:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169658112 00000100:00100000:1.0:1790391623.053273:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169658112 00000100:00100000:1.0:1790391623.053285:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169658624 00000100:00100000:1.0:1790391623.053287:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169658624 00000100:00100000:1.0:1790391623.053300:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:1.0:1790391623.053305:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5287b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169658240:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391623.053328:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5287b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169658240:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 23us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.053334:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00080000:0.0:1790391623.053400:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790391623.053403:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391623.053619:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391623.053702:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169658752:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391623.053751:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169658752:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 52us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.053757:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:1.0:1790391623.053769:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:1.0:1790391623.053775:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169658112:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391623.053796:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169658112:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 23us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.053802:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:1.0:1790391623.053811:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:1.0:1790391623.053816:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169658624:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:1.0:1790391623.053843:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2382:x1877361169658624:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 26us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.053848:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:3.0:1790391623.062648:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169657856 00000100:00100000:3.0:1790391623.062669:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169657856 00000100:00100000:3.0:1790391623.066432:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 165 00000100:00100000:3.0:1790391623.066449:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+13:2381:x1877361169657856:12345-192.168.202.28@tcp:400:kworker.0 00000100:00100000:0.0:1790391623.067226:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.067342:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169658880 00000100:00100000:2.0:1790391623.067352:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169658880 00000100:00100000:2.0:1790391623.067433:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:2.0:1790391623.067442:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:15582:x1877361169658880:12345-192.168.202.28@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790391623.067552:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:15582:x1877361169658880:12345-192.168.202.28@tcp:900:lhsmtool_posix.0 Request processed in 111us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.067560:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:0.0:1790391623.073576:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.074093:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b77a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de820afa-b30f-4af2-bd45-eaefa881a982+13:2381:x1877361169657856:12345-192.168.202.28@tcp:400:kworker.0 Request processed in 7643us (21451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.074106:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 165 00000100:00100000:1.0:1790391623.074322:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169659136 00000100:00100000:1.0:1790391623.074332:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169659136 00000100:00100000:1.0:1790391623.074382:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:1.0:1790391623.074393:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:15582:x1877361169659136:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391623.074412:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391623.074436:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e2663 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b05de expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074513:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e266a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074544:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e266a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074557:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e266a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074623:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e2671 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074642:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e2671 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074648:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e2671 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074762:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e2678 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074770:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e2678 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074777:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e2678 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391623.074787:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1790391623.074972:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e266a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074980:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e266a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074986:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e266a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.074998:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391623.075003:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e266a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.075010:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e266a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.075021:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e52b9b6c800) 00010000:00010000:1.0:1790391623.075023:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391623.075028:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e266a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.075034:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e266a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.075046:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e2671 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.075051:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e2671 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.075056:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e2671 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.075060:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391623.075062:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e2671 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.075067:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e2671 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.075084:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e5283a48f00) 00010000:00010000:1.0:1790391623.075086:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391623.075089:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e2671 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.075094:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e2671 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391623.075932:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.076018:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169659264 00000100:00100000:0.0:1790391623.076025:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169659264 00000100:00100000:0.0:1790391623.076059:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 25 00000100:00100000:0.0:1790391623.076068:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+10:15588:x1877361169659264:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391623.076079:0:20339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.076093:0:20339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2686 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b05e5 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076136:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e268d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076159:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e268d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076169:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e268d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076182:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e2694 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076188:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e2694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076201:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e2694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076231:0:20339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e268d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076238:0:20339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e268d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076256:0:20339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e268d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076263:0:20339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391623.076267:0:20339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e268d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076274:0:20339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e268d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076284:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bba00) 00010000:00010000:0.0:1790391623.076287:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391623.076290:0:20339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e268d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076297:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e268d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076308:0:20339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e2694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076314:0:20339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e2694 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076324:0:20339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e2694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076329:0:20339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391623.076331:0:20339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e2694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076337:0:20339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e2694 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076344:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e51831af800) 00010000:00010000:0.0:1790391623.076346:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391623.076348:0:20339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e2694 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076353:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e2694 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076393:0:20339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2686 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05e5 expref: 11 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076404:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bba00) 00010000:00010000:0.0:1790391623.076406:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391623.076409:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2686 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05e5 expref: 11 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.076419:0:20339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145000, rc 0) 00000100:00100000:0.0:1790391623.076474:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+10:15588:x1877361169659264:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 406us (548us total) trans 0 rc 301/301 00000100:00100000:0.0:1790391623.076492:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 25 00010000:00010000:0.0:1790391623.078415:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e2663 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05de expref: 10 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.078441:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087200/0x2b1b7949f13e2678 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05de expref: 9 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.078449:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:0.0:1790391623.078452:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391623.078455:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087200, rc 0) 00000100:00100000:0.0:1790391623.078529:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+9:15582:x1877361169659136:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 4137us (4964us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790391623.078538:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:2.0:1790391623.092042:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.092400:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.092498:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169659520 00000100:00100000:1.0:1790391623.092508:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169659520 00000100:00100000:1.0:1790391623.092574:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:1.0:1790391623.092584:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+9:15582:x1877361169659520:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790391623.092674:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+9:15582:x1877361169659520:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 Request processed in 92us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.092679:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:0.0:1790391623.092843:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169659392 00000100:00100000:0.0:1790391623.092851:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169659392 00000100:00100000:2.0:1790391623.093017:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:2.0:1790391623.093026:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+9:15588:x1877361169659392:12345-192.168.202.28@tcp:700:lfs.0 00000100:00100000:2.0:1790391623.093063:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+9:15588:x1877361169659392:12345-192.168.202.28@tcp:700:lfs.0 Request processed in 39us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.093070:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:1.0:1790391623.094661:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.094690:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.095069:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169659648 00000100:00100000:2.0:1790391623.095079:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169659648 00000100:00100000:2.0:1790391623.095134:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169659904 00000100:00100000:2.0:1790391623.095138:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169659904 00000100:00100000:2.0:1790391623.095171:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:2.0:1790391623.095180:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:15582:x1877361169659648:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790391623.095466:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:0.0:1790391623.095473:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+9:15588:x1877361169659904:12345-192.168.202.28@tcp:36:lfs.0 00010000:00010000:0.0:1790391623.095510:0:17202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391623.095533:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280031400/0x2b1b7949f13e25b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0552 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.095548:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bba00) 00010000:00010000:0.0:1790391623.095552:0:17202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391623.095603:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.095614:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c2 expref: 5 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.095624:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.095651:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c2 expref: 5 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.095661:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c2 expref: 5 pid: 17201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391623.095671:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518229e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17202:1877361186524928:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391623.095761:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528916e900 going to sleep for 11 seconds 00000100:00100000:3.0:1790391623.098864:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518229e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17202:1877361186524928:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391623.098922:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790391623.099053:0:17201:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3828us 00000100:00100000:1.0:1790391623.099836:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.099896:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169660032 00000100:00100000:0.0:1790391623.099975:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169660032 00010000:00010000:0.0:1790391623.100015:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c2 expref: 6 pid: 17201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391623.100052:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 15 00000100:00100000:0.0:1790391623.100062:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:2384:x1877361169660032:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391623.100077:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391623.100095:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c2 expref: 6 pid: 17201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.100107:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c2 expref: 6 pid: 17201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.100152:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5280030200/0x2b1b7949f13e25f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05c2 expref: 6 pid: 17201 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.100170:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bba00) 00010000:00010000:0.0:1790391623.100177:0:17189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.100195:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.100203:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.100234:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391623.100270:0:17202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.100277:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.100310:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.100320:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.100335:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391623.100657:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:2384:x1877361169660032:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 593us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391623.100666:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 15 00010000:00010000:1.0:1790391623.102578:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102596:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102605:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391623.102617:0:17202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042ef2bbf reply state 00000000764a527a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102624:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102629:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:1.0:1790391623.102631:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391623.102633:0:17202:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790391623.102638:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790391623.102644:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102648:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102653:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102656:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391623.102664:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102669:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102677:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e51821bba00) 00010000:00010000:1.0:1790391623.102678:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391623.102681:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102686:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e269b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391623.102700:0:17202:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042ef2bbf reply state 00000000764a527a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102704:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.102708:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e5283a48f00) 00010000:00010000:1.0:1790391623.102710:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391623.102711:0:17202:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1790391623.102801:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+10:15588:x1877361169659904:12345-192.168.202.28@tcp:36:lfs.0 Request processed in 7325us (8106us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790391623.102808:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:1.0:1790391623.113895:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:15582:x1877361169659648:12345-192.168.202.28@tcp:59:lhsmtool_posix.0 Request processed in 18687us (19212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.113911:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:3.0:1790391623.157442:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.157502:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169660160 00000100:00100000:1.0:1790391623.157513:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169660160 00000100:00100000:1.0:1790391623.157578:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:1.0:1790391623.157588:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+10:15596:x1877361169660160:12345-192.168.202.28@tcp:101:lctl.0 00010000:00010000:1.0:1790391623.157612:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391623.157632:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e26b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b05ec expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.157689:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e26b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.157700:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e26b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.157708:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e26b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391623.157748:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790391623.157752:0:17203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391623.157847:0:17203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e26b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.157873:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e26b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05ec expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.157938:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086600/0x2b1b7949f13e26b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05ec expref: 11 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.157947:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391623.157950:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391623.157954:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183086600, rc 0) 00000100:00100000:1.0:1790391623.158014:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+11:15596:x1877361169660160:12345-192.168.202.28@tcp:101:lctl.0 Request processed in 428us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.158028:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:1.0:1790391623.176345:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790391623.176375:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186525056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790391623.176463:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391623.176710:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186525184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790391623.176753:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391623.176902:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186525056 00000100:00100000:2.0:1790391623.176912:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186525056 00000100:00100000:2.0:1790391623.176973:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186525184 00000100:00100000:2.0:1790391623.176976:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186525184 00000100:00100000:2.0:1790391623.176993:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391623.177002:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186525056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790391623.177049:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790391623.177112:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877361186525056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.177120:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790391623.177137:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391623.177143:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186525184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790391623.177152:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790391623.177177:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186525184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.177183:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790391623.177223:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186525184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790391623.177238:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1877361186525056:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790391623.177579:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790391623.177646:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790391623.184492:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.184581:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169660288 00000100:00100000:1.0:1790391623.184591:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169660288 00000100:00100000:1.0:1790391623.184656:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:1.0:1790391623.184667:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:15597:x1877361169660288:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:1.0:1790391623.184691:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391623.184715:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e26be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b05f3 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.184794:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087a00/0x2b1b7949f13e26c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.184806:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087a00/0x2b1b7949f13e26c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.184816:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087a00/0x2b1b7949f13e26c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391623.184866:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790391623.184870:0:17202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391623.184933:0:17202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087a00/0x2b1b7949f13e26c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.184980:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e26be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05f3 expref: 7 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.185000:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087a00/0x2b1b7949f13e26c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05f3 expref: 6 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.185006:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:1.0:1790391623.185008:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790391623.185011:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087a00, rc 0) 00000100:00100000:1.0:1790391623.185061:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:15597:x1877361169660288:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 397us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.185067:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 30 00000100:00100000:3.0:1790391623.189950:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.190187:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169660416 00000100:00100000:2.0:1790391623.190198:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169660416 00000100:00100000:2.0:1790391623.190271:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:2.0:1790391623.190281:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+6:15597:x1877361169660416:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:2.0:1790391623.190312:0:20339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391623.190335:0:20339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b05fa expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190405:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e26d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190416:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e26d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190440:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e26d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190448:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e26da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190452:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e26da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190456:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e26da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190522:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e26e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190527:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e26e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190530:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e26e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790391623.190563:0:20339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790391623.190566:0:20339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790391623.190585:0:20339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e26e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190595:0:20339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e26d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190599:0:20339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e26d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190610:0:20339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e26d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190614:0:20339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391623.190617:0:20339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e26d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190622:0:20339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e26d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190631:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:2.0:1790391623.190633:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391623.190637:0:20339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e26d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190641:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e26d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190650:0:20339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e26da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190654:0:20339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e26da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190657:0:20339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e26da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190660:0:20339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309dc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391623.190662:0:20339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e26da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190671:0:20339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e26da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190676:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e5283a48f00) 00010000:00010000:2.0:1790391623.190677:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391623.190678:0:20339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e26da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190681:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e26da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190700:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05fa expref: 8 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190708:0:20339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e26e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05fa expref: 7 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.190712:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391623.190713:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790391623.190715:0:20339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c800, rc 0) 00000100:00100000:2.0:1790391623.190783:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+7:15597:x1877361169660416:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 503us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.190790:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 31 00000100:00100000:3.0:1790391623.195437:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.195746:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169660544 00000100:00100000:2.0:1790391623.195758:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169660544 00000100:00100000:2.0:1790391623.195814:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:2.0:1790391623.195829:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:15597:x1877361169660544:12345-192.168.202.28@tcp:900:lfs.0 00000100:00100000:2.0:1790391623.195974:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:957e4510-6da1-45ee-bf96-cb07984ae4a9+5:15597:x1877361169660544:12345-192.168.202.28@tcp:900:lfs.0 Request processed in 150us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.195982:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:1.0:1790391623.198939:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.199029:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169660800 00000100:00100000:0.0:1790391623.199039:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169660800 00000100:00100000:0.0:1790391623.199110:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:0.0:1790391623.199120:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+7:15597:x1877361169660800:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391623.199141:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.199166:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e26e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0601 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391623.199464:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790391623.199584:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e26e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0601 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.199612:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391623.199615:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391623.199621:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e26e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0601 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.199636:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145600, rc 0) 00000100:00100000:0.0:1790391623.199700:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+8:15597:x1877361169660800:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 583us (775us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1790391623.199706:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 32 00000100:00100000:1.0:1790391623.202468:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.202551:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169661056 00000100:00100000:2.0:1790391623.202559:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169661056 00000100:00100000:2.0:1790391623.202625:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:2.0:1790391623.202634:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+8:15597:x1877361169661056:12345-192.168.202.28@tcp:36:lfs.0 00010000:00010000:2.0:1790391623.202700:0:20339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391623.202721:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e26e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b05fa expref: 8 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.202746:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391623.202751:0:20339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790391623.202774:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.202787:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.202795:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790391623.203021:0:20339:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004760d4d4 reply state 00000000aea09f75 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.203031:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.203035:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:2.0:1790391623.203042:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790391623.203044:0:20339:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790391623.203051:0:20339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790391623.203130:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:957e4510-6da1-45ee-bf96-cb07984ae4a9+9:15597:x1877361169661056:12345-192.168.202.28@tcp:36:lfs.0 Request processed in 494us (669us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790391623.203137:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 33 00000100:00100000:3.0:1790391623.204988:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.205054:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169661312 00000100:00100000:1.0:1790391623.205061:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169661312 00000100:00100000:1.0:1790391623.205106:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:1.0:1790391623.205113:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+9:15597:x1877361169661312:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391623.205333:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+10:15597:x1877361169661312:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 220us (357us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790391623.205339:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:1.0:1790391623.210146:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.210270:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169661568 00000100:00100000:0.0:1790391623.210279:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169661568 00000100:00100000:0.0:1790391623.210334:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 34 00000100:00100000:0.0:1790391623.210343:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+10:15597:x1877361169661568:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391623.210365:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.210382:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e26fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0608 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210447:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e2704 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210458:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e2704 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210467:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e2704 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210475:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e270b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210493:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e270b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210498:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e270b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391623.210604:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790391623.210676:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e2704 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210684:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e2704 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210691:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e2704 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210697:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145a00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391623.210702:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e2704 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210710:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e2704 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210721:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391623.210725:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391623.210729:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e2704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210735:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e2704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210759:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e270b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210764:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e270b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210769:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e270b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210774:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391623.210777:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e270b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210782:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e270b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210790:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e5283a48f00) 00010000:00010000:0.0:1790391623.210792:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391623.210794:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e270b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210799:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e270b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210830:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e26fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0608 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210840:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391623.210842:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391623.210852:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e26fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0608 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.210862:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145600, rc 0) 00000100:00100000:0.0:1790391623.210964:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+11:15597:x1877361169661568:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 621us (831us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1790391623.210971:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 34 00000100:00100000:3.0:1790391623.214237:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.214511:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169661696 00000100:00100000:0.0:1790391623.214520:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169661696 00000100:00100000:0.0:1790391623.214605:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:0.0:1790391623.214614:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+11:15597:x1877361169661696:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391623.214636:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.214652:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2719 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b060f expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.214739:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.214749:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.214757:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391623.214775:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790391623.214777:0:17203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391623.214791:0:17203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.214811:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2719 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b060f expref: 13 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.214845:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b060f expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.214851:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391623.214853:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790391623.214856:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145200, rc 0) 00000100:00100000:0.0:1790391623.215145:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:957e4510-6da1-45ee-bf96-cb07984ae4a9+12:15597:x1877361169661696:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 531us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391623.215151:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 35 00000100:00100000:3.0:1790391623.218559:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.218612:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169661824 00000100:00100000:1.0:1790391623.218621:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169661824 00000100:00100000:1.0:1790391623.218701:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:1.0:1790391623.218709:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+12:15597:x1877361169661824:12345-192.168.202.28@tcp:37:lfs.0 00000100:00100000:2.0:1790391623.222487:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:957e4510-6da1-45ee-bf96-cb07984ae4a9+12:15597:x1877361169661824:12345-192.168.202.28@tcp:37:lfs.0 Request processed in 3764us (3923us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.222501:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 3 00000100:00100000:3.0:1790391623.225384:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.225444:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169662080 00000100:00100000:2.0:1790391623.225454:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169662080 00000100:00100000:2.0:1790391623.225544:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:2.0:1790391623.225553:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+12:15597:x1877361169662080:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:2.0:1790391623.225760:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+13:15597:x1877361169662080:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 207us (385us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790391623.225768:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 4 00000100:00100000:3.0:1790391623.264843:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.265106:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169662208 00000100:00100000:0.0:1790391623.265116:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169662208 00000100:00100000:0.0:1790391623.265186:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 36 00000100:00100000:0.0:1790391623.265198:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+11:15603:x1877361169662208:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:0.0:1790391623.265221:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.265253:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2727 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0616 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265317:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e272e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265332:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e272e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265344:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e272e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265356:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2735 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265375:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265380:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265446:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e273c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265451:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e273c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265455:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e273c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391623.265483:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790391623.265486:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790391623.265516:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e273c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265526:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e272e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265531:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e272e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265535:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e272e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265539:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145600 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391623.265542:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e272e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265552:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e272e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265561:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391623.265563:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391623.265566:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e272e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265570:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e272e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265580:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265583:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2735 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265587:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2735 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265590:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145c00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391623.265591:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2735 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265594:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2735 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265598:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e5283a48f00) 00010000:00010000:0.0:1790391623.265599:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391623.265600:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2735 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265610:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2735 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265629:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2727 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0616 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265638:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145a00/0x2b1b7949f13e273c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0616 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.265643:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391623.265644:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790391623.265646:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145a00, rc 0) 00000100:00100000:0.0:1790391623.265707:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+12:15603:x1877361169662208:12345-192.168.202.28@tcp:101:bash.0 Request processed in 513us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391623.265714:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 36 00000100:00100000:3.0:1790391623.269676:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.269775:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169662336 00000100:00100000:2.0:1790391623.269787:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169662336 00000100:00100000:2.0:1790391623.272453:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:2.0:1790391623.272480:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:15603:x1877361169662336:12345-192.168.202.28@tcp:900:bash.0 00000100:00100000:2.0:1790391623.272596:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:15603:x1877361169662336:12345-192.168.202.28@tcp:900:bash.0 Request processed in 128us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.272605:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:2.0:1790391623.285031:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391623.285107:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169662592 00000100:00100000:3.0:1790391623.285117:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169662592 00000100:00100000:3.0:1790391623.285183:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 37 00000100:00100000:3.0:1790391623.285194:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+12:15603:x1877361169662592:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:3.0:1790391623.285217:0:20339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391623.285240:0:20339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2743 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b061d expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.285374:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.285392:0:20339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b060f expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.285400:0:20339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.285445:0:20339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b060f expref: 12 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.285475:0:20339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b060f expref: 12 pid: 17203 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391623.285490:0:20339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183290000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20339:1877361186525312:192.168.202.28@tcp:104: 00000100:00100000:3.0:1790391623.285650:0:20339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da540 going to sleep for 11 seconds 00000100:00100000:3.0:1790391623.289549:0:20339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183290000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20339:1877361186525312:192.168.202.28@tcp:104: 00010000:00010000:3.0:1790391623.289584:0:20339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391623.290461:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391623.290686:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169662720 00000100:00100000:3.0:1790391623.290695:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169662720 00010000:00010000:3.0:1790391623.290734:0:17188:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b060f expref: 13 pid: 17203 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391623.290774:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 16 00000100:00100000:3.0:1790391623.290784:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+13:2383:x1877361169662720:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391623.290800:0:17188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391623.290808:0:17188:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b060f expref: 13 pid: 17203 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.290833:0:17188:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b060f expref: 13 pid: 17203 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.290858:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2720 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b060f expref: 13 pid: 17203 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.290933:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:3.0:1790391623.290938:0:17188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.290949:0:17188:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.290958:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.290984:0:17188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391623.291042:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:957e4510-6da1-45ee-bf96-cb07984ae4a9+12:2383:x1877361169662720:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 258us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391623.291049:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 16 00010000:00010000:0.0:1790391623.291160:0:20339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291169:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291193:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291203:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291210:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291782:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291793:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291800:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391623.291812:0:20339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790391623.291852:0:20339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291860:0:20339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291868:0:20339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291908:0:20339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9ca00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391623.291915:0:20339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291924:0:20339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291934:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391623.291936:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391623.291940:0:20339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291959:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9ca00/0x2b1b7949f13e274a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790391623.291971:0:20339:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aec1433e reply state 00000000ea967ff3 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291982:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.291988:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e51831af800) 00010000:00010000:0.0:1790391623.291990:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790391623.291993:0:20339:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790391623.292031:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d800/0x2b1b7949f13e2743 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b061d expref: 15 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.292045:0:20339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b061d expref: 14 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.292052:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:0.0:1790391623.292054:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1790391623.292056:0:20339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145c00, rc 0) 00000100:00100000:0.0:1790391623.292098:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+15:15603:x1877361169662592:12345-192.168.202.28@tcp:101:bash.0 Request processed in 6906us (7079us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790391623.292105:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 37 00000100:00100000:0.0:1790391623.309608:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.309683:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169662848 00000100:00100000:1.0:1790391623.309692:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169662848 00000100:00100000:1.0:1790391623.309748:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 38 00000100:00100000:1.0:1790391623.309759:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+15:15603:x1877361169662848:12345-192.168.202.28@tcp:101:bash.0 00010000:00010000:1.0:1790391623.309787:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391623.309809:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e2766 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0624 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.309919:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.309934:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.309946:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391623.310001:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790391623.310006:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391623.310028:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.310038:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.310059:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086e00/0x2b1b7949f13e2766 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0624 expref: 17 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.310074:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0624 expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.310211:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:1.0:1790391623.310214:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790391623.310218:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5183087c00, rc 0) 00000100:00100000:1.0:1790391623.310343:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+16:15603:x1877361169662848:12345-192.168.202.28@tcp:101:bash.0 Request processed in 585us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.310351:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 38 00000100:00100000:1.0:1790391623.315325:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.315480:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169663104 00000100:00100000:2.0:1790391623.315490:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169663104 00000100:00100000:2.0:1790391623.315568:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:2.0:1790391623.315578:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+16:15603:x1877361169663104:12345-192.168.202.28@tcp:35:bash.0 00000100:00100000:2.0:1790391623.315917:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+17:15603:x1877361169663104:12345-192.168.202.28@tcp:35:bash.0 Request processed in 339us (603us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1790391623.315924:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 5 00000100:00100000:2.0:1790391623.421484:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.421661:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169663360 00000100:00100000:0.0:1790391623.421673:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169663360 00000100:00100000:0.0:1790391623.421760:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:0.0:1790391623.421788:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+17:15613:x1877361169663360:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391623.421814:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.421850:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b062b expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391623.422012:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790391623.422112:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2774 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b062b expref: 19 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.422127:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e5283a48c00) 00010000:00010000:0.0:1790391623.422130:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391623.422136:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b062b expref: 19 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.422151:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145400, rc 0) 00000100:00100000:0.0:1790391623.422205:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+18:15613:x1877361169663360:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 421us (735us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1790391623.422213:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 39 00000100:00100000:0.0:1790391623.434586:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.434713:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169663616 00000100:00100000:2.0:1790391623.434789:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169663616 00000100:00100000:2.0:1790391623.434989:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:2.0:1790391623.435002:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+18:15613:x1877361169663616:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:2.0:1790391623.435377:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+19:15613:x1877361169663616:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 377us (804us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1790391623.435385:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 6 00000100:00100000:1.0:1790391623.480919:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.481022:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169663872 00000100:00100000:0.0:1790391623.481033:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169663872 00000100:00100000:0.0:1790391623.481099:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:0.0:1790391623.481109:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+19:15616:x1877361169663872:12345-192.168.202.28@tcp:101:lfs.0 00010000:00010000:0.0:1790391623.481135:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.481157:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2782 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0632 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.481323:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e2789 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.481339:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e2789 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.481351:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e2789 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391623.481362:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790391623.481475:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2782 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0632 expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.481497:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e2789 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0632 expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.481506:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:0.0:1790391623.481509:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391623.481513:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144000, rc 0) 00000100:00100000:0.0:1790391623.481591:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+21:15616:x1877361169663872:12345-192.168.202.28@tcp:101:lfs.0 Request processed in 483us (715us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1790391623.481599:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 40 00000100:00100000:3.0:1790391623.496583:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391623.496638:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.496810:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169664128 00000100:00100000:2.0:1790391623.496821:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169664128 00000100:00100000:2.0:1790391623.496946:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:2.0:1790391623.496958:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+21:2383:x1877361169664128:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391623.496974:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391623.497000:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e2789 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0632 expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391623.497019:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:2.0:1790391623.497026:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391623.497074:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+20:2383:x1877361169664128:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 118us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391623.497082:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:0.0:1790391623.497539:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169664000 00000100:00100000:0.0:1790391623.497547:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169664000 00000100:00100000:0.0:1790391623.497598:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 41 00000100:00100000:0.0:1790391623.497606:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+20:15616:x1877361169664000:12345-192.168.202.28@tcp:54:lfs.0 00010000:00010000:0.0:1790391623.497668:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2797 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.497690:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2797 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.497699:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2797 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.497733:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2797 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.497741:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2797 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.497748:0:17203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2797 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.497753:0:17203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391623.497757:0:17203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2797 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.497765:0:17203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2797 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.497773:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:0.0:1790391623.497777:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790391623.497781:0:17203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2797 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.497787:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e2797 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391623.497852:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+20:15616:x1877361169664000:12345-192.168.202.28@tcp:54:lfs.0 Request processed in 246us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391623.497867:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 41 00000100:00100000:3.0:1790391623.503560:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391623.503691:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169664384 00000100:00100000:1.0:1790391623.503699:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169664384 00000100:00100000:1.0:1790391623.503760:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 7 00000100:00100000:1.0:1790391623.503771:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+20:15616:x1877361169664384:12345-192.168.202.28@tcp:35:lfs.0 00000100:00100000:1.0:1790391623.504009:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+21:15616:x1877361169664384:12345-192.168.202.28@tcp:35:lfs.0 Request processed in 241us (459us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1790391623.504017:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 7 00000040:00080000:0.0:1790391623.560578:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790391623.689386:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790391623.689419:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bfb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186525440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790391623.689498:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391623.689633:0:18189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186525440 00000100:00100000:1.0:1790391623.689643:0:18189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186525440 00000100:00100000:1.0:1790391623.689693:0:18189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790391623.689701:0:18189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186525440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790391623.689733:0:18189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790391623.689778:0:18189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186525440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.689785:0:18189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790391623.689854:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186525568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790391623.689906:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790391623.689956:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bfb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186525440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790391623.690025:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186525568 00000100:00100000:1.0:1790391623.690030:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186525568 00000100:00100000:1.0:1790391623.690075:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790391623.690081:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186525568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790391623.690101:0:17207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790391623.690141:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186525568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.690147:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790391623.690209:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186525568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790391623.734122:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.734220:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169664640 00000100:00100000:0.0:1790391623.734230:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169664640 00000100:00100000:0.0:1790391623.734318:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 42 00000100:00100000:0.0:1790391623.734329:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+21:15647:x1877361169664640:12345-192.168.202.28@tcp:101:cat.0 00010000:00010000:0.0:1790391623.734354:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.734375:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e279e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0639 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.734482:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.734496:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.734509:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391623.734520:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790391623.734658:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e279e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0639 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.734678:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0639 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.734687:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:0.0:1790391623.734689:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790391623.734693:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144c00, rc 0) 00000100:00100000:0.0:1790391623.734775:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+23:15647:x1877361169664640:12345-192.168.202.28@tcp:101:cat.0 Request processed in 448us (666us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1790391623.734782:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 42 00000100:00100000:3.0:1790391623.743017:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391623.743089:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.743192:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169665024 00000100:00100000:0.0:1790391623.743202:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169665024 00000100:00100000:0.0:1790391623.743277:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:0.0:1790391623.743288:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+23:2384:x1877361169665024:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790391623.743560:0:17188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391623.743588:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0639 expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.743606:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:0.0:1790391623.743611:0:17188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391623.743674:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+22:2384:x1877361169665024:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 388us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391623.743683:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:1.0:1790391623.745124:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169664896 00000100:00100000:1.0:1790391623.745135:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169664896 00000100:00100000:1.0:1790391623.745188:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 8 00000100:00100000:1.0:1790391623.745199:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+22:15647:x1877361169664896:12345-192.168.202.28@tcp:35:cat.0 00000100:00100000:1.0:1790391623.746122:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+23:15647:x1877361169664896:12345-192.168.202.28@tcp:35:cat.0 Request processed in 920us (3110us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1790391623.746132:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 8 00000040:00080000:2.0:1790391623.755098:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790391623.796134:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.796175:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169665280 00000100:00100000:0.0:1790391623.796186:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169665280 00000100:00100000:0.0:1790391623.796276:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 43 00000100:00100000:0.0:1790391623.796288:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+23:15653:x1877361169665280:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:0.0:1790391623.796313:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.796337:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27b3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0640 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.796447:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.796462:0:17203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b061d expref: 24 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.796472:0:17203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0624 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.796481:0:17203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.796514:0:17203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0624 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.796529:0:17203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0624 expref: 24 pid: 17201 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391623.796543:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17203:1877361186525696:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391623.796641:0:17203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b061d expref: 24 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.796665:0:17203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b061d expref: 24 pid: 20339 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391623.796676:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17203:1877361186525824:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391623.796704:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528916e240 going to sleep for 11 seconds 00000100:00100000:0.0:1790391623.798087:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17203:1877361186525696:192.168.202.28@tcp:104: 00000100:00100000:0.0:1790391623.798097:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17203:1877361186525824:192.168.202.28@tcp:104: 00010000:00010000:0.0:1790391623.798113:0:17203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391623.798971:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391623.798999:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391623.799054:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169665408 00000100:00100000:3.0:1790391623.799060:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169665408 00010000:00010000:3.0:1790391623.799088:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0624 expref: 25 pid: 17201 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391623.799111:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169665536 00000100:00100000:3.0:1790391623.799119:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169665536 00010000:00010000:3.0:1790391623.799127:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b061d expref: 26 pid: 20339 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391623.799162:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 17 00000100:00100000:3.0:1790391623.799187:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+26:2383:x1877361169665408:12345-192.168.202.28@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790391623.799195:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 18 00010000:00010000:3.0:1790391623.799201:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790391623.799204:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b778f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+26:2383:x1877361169665536:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391623.799208:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0624 expref: 26 pid: 17201 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.799210:0:17188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391623.799215:0:17188:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b061d expref: 26 pid: 20339 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.799220:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0624 expref: 26 pid: 17201 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.799233:0:17188:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b061d expref: 26 pid: 20339 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.799377:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145c00/0x2b1b7949f13e2758 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b061d expref: 26 pid: 20339 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.799406:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:1.0:1790391623.799411:0:17188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.799419:0:17188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391623.799426:0:17188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391623.799577:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b778f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+25:2383:x1877361169665536:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 374us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391623.799590:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 18 00010000:00010000:3.0:1790391623.799950:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087c00/0x2b1b7949f13e276d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0624 expref: 24 pid: 17201 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.799963:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:3.0:1790391623.799967:0:17187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.799975:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.799982:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.800011:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391623.800046:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+23:2383:x1877361169665408:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 867us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391623.800055:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 17 00010000:00010000:0.0:1790391623.800060:0:17203:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.800070:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790391623.800089:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790391623.800224:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27b3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0640 expref: 24 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.800235:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145400/0x2b1b7949f13e27ba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0640 expref: 23 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.800252:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:0.0:1790391623.800253:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790391623.800255:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145400, rc 0) 00000100:00100000:0.0:1790391623.800403:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+23:15653:x1877361169665280:12345-192.168.202.28@tcp:101:dd.0 Request processed in 4118us (4286us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1790391623.800411:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 43 00000100:00100000:2.0:1790391623.803064:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.803136:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169665664 00000100:00100000:0.0:1790391623.803144:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169665664 00000100:00100000:0.0:1790391623.803377:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:0.0:1790391623.803389:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+23:15653:x1877361169665664:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:0.0:1790391623.803415:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.803437:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0647 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.803471:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.803484:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.803495:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.803607:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0647 expref: 25 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.803624:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0647 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.803630:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:0.0:1790391623.803632:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790391623.803635:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295145600, rc 0) 00000100:00100000:0.0:1790391623.803691:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+24:15653:x1877361169665664:12345-192.168.202.28@tcp:101:dd.0 Request processed in 305us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391623.803696:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 44 00000100:00100000:2.0:1790391623.807450:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391623.807551:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169665920 00000100:00100000:3.0:1790391623.807575:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169665920 00000100:00100000:3.0:1790391623.807654:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 45 00000100:00100000:3.0:1790391623.807664:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+24:15653:x1877361169665920:12345-192.168.202.28@tcp:36:dd.0 00010000:00010000:3.0:1790391623.810098:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.810120:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.810129:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391623.810188:0:20339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1790391623.810208:0:20339:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a28cf16 reply state 0000000003812a43 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.810217:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.810222:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:3.0:1790391623.810224:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790391623.810227:0:20339:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790391623.810341:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+27:15653:x1877361169665920:12345-192.168.202.28@tcp:36:dd.0 Request processed in 2675us (2902us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1790391623.810350:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 45 00000020:00080000:3.0:1790391623.810356:0:20339:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790391623.812388:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391623.812465:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169666048 00000100:00100000:3.0:1790391623.812474:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169666048 00000100:00100000:3.0:1790391623.812514:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:3.0:1790391623.812521:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+27:15653:x1877361169666048:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:3.0:1790391623.812548:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790391623.812564:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c600/0x2b1b7949f13e27dd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b064e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.812608:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c600/0x2b1b7949f13e27dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b064e expref: 28 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.812657:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c600/0x2b1b7949f13e27dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b064e expref: 28 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391623.812673:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:3.0:1790391623.812675:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391623.812677:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e52bab9c600, rc 0) 00000100:00100000:3.0:1790391623.812753:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+28:15653:x1877361169666048:12345-192.168.202.28@tcp:101:dd.0 Request processed in 231us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391623.812761:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 46 00000100:00100000:1.0:1790391623.825353:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.825415:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169666304 00000100:00100000:0.0:1790391623.825427:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169666304 00000100:00100000:0.0:1790391623.825501:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:0.0:1790391623.825512:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+28:15653:x1877361169666304:12345-192.168.202.28@tcp:103:dd.0 00010000:00010000:0.0:1790391623.825527:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391623.825555:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c600/0x2b1b7949f13e27dd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b064e expref: 28 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.825577:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:0.0:1790391623.825582:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790391623.825670:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+27:15653:x1877361169666304:12345-192.168.202.28@tcp:103:dd.0 Request processed in 160us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391623.825678:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 2 00000100:00100000:2.0:1790391623.835342:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.835677:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169666432 00000100:00100000:0.0:1790391623.835687:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169666432 00000100:00100000:0.0:1790391623.835743:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:0.0:1790391623.835753:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+27:15653:x1877361169666432:12345-192.168.202.28@tcp:58:dd.0 00010000:00010000:0.0:1790391623.835913:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.835932:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.835943:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391623.836994:0:17203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790391623.837027:0:17203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1790391623.837189:0:17203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1790391623.837315:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+27:15653:x1877361169666432:12345-192.168.202.28@tcp:58:dd.0 Request processed in 1558us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391623.837327:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 47 00000100:00100000:3.0:1790391623.839874:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391623.839950:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169666560 00000100:00100000:0.0:1790391623.839961:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169666560 00000100:00100000:0.0:1790391623.840015:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 48 00000100:00100000:0.0:1790391623.840031:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+27:15653:x1877361169666560:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:0.0:1790391623.840053:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790391623.840073:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0655 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.840129:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.840141:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27eb lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0655 expref: 28 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.840161:0:17201:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.840175:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27eb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0655 expref: 28 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.840188:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:0.0:1790391623.840205:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790391623.840210:0:17201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27eb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0655 expref: 28 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391623.840219:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5295144c00, rc 0) 00000100:00100000:0.0:1790391623.840288:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+28:15653:x1877361169666560:12345-192.168.202.28@tcp:101:dd.0 Request processed in 263us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391623.840295:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 48 00010000:00010000:0.0:1790391624.200059:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790391624.586404:0:17237:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790391624.586416:0:17237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790391624.586465:0:17237:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790391624.586477:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790391624.586627:0:17237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17237:1877361186525952:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790391624.586711:0:17237:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e528916e240 going to sleep for 11 seconds 00000100:00100000:3.0:1790391624.590930:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391624.591065:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169666688 00000100:00100000:2.0:1790391624.591074:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169666688 00000100:00100000:2.0:1790391624.591141:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 49 00000100:00100000:2.0:1790391624.591151:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+29:15655:x1877361169666688:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790391624.591182:0:20339:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790391624.591456:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+29:15655:x1877361169666688:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 304us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391624.591465:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 49 00000100:00100000:0.0:1790391624.593477:0:17237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17237:1877361186525952:192.168.202.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790391624.598133:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391624.598228:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169666816 00000100:00100000:3.0:1790391624.598249:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169666816 00000100:00100000:3.0:1790391624.598468:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 50 00000100:00100000:3.0:1790391624.598481:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+28:15655:x1877361169666816:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790391624.598561:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e27f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598580:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e27f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598609:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e27f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598668:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d200/0x2b1b7949f13e27f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598677:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d200/0x2b1b7949f13e27f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598685:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d200/0x2b1b7949f13e27f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598711:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598720:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598726:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790391624.598775:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790391624.598780:0:17202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790391624.598797:0:17202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598810:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e27f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598829:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e27f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598848:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e27f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598853:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9c800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391624.598857:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e27f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598864:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e27f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598909:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:3.0:1790391624.598913:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391624.598918:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e27f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598924:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9c800/0x2b1b7949f13e27f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598937:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d200/0x2b1b7949f13e27f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598942:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d200/0x2b1b7949f13e27f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598947:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d200/0x2b1b7949f13e27f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598952:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391624.598955:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d200/0x2b1b7949f13e27f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598970:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d200/0x2b1b7949f13e27f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598979:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9e51821bb800) 00010000:00010000:3.0:1790391624.598981:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391624.598984:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d200/0x2b1b7949f13e27f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.598989:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9d200/0x2b1b7949f13e27f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.599003:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.599009:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.599014:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.599018:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9cc00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391624.599021:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.599026:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.599033:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:3.0:1790391624.599035:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790391624.599038:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.599053:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9cc00/0x2b1b7949f13e2800 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391624.599140:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+28:15655:x1877361169666816:12345-192.168.202.28@tcp:34:lhsmtool_posix.0 Request processed in 661us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391624.599149:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 50 00000100:00100000:2.0:1790391624.606461:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391624.606537:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169667072 00000100:00100000:1.0:1790391624.606546:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169667072 00000100:00100000:1.0:1790391624.606632:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:1.0:1790391624.606643:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+28:15655:x1877361169667072:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391624.606663:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391624.606686:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055600/0x2b1b7949f13e2807 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b065c expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.606807:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e280e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.606833:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e280e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.606844:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e280e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391624.606870:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790391624.606986:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e280e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.606993:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e280e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.607000:0:17203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e280e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.607006:0:17203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055400 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391624.607010:0:17203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e280e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.607019:0:17203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e280e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.607031:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:1.0:1790391624.607034:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790391624.607039:0:17203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e280e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.607045:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e280e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.607087:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055600/0x2b1b7949f13e2807 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b065c expref: 30 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.607096:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e5283a48100) 00010000:00010000:1.0:1790391624.607098:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790391624.607108:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055600/0x2b1b7949f13e2807 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b065c expref: 30 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.607117:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055600, rc 0) 00000100:00100000:1.0:1790391624.607180:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+29:15655:x1877361169667072:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 538us (731us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1790391624.607187:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 51 00000100:00100000:2.0:1790391624.614228:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391624.614340:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169667200 00000100:00100000:0.0:1790391624.614349:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169667200 00000100:00100000:0.0:1790391624.614405:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:0.0:1790391624.614415:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+29:15655:x1877361169667200:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790391624.614452:0:17201:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790391624.614572:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+29:15655:x1877361169667200:12345-192.168.202.28@tcp:53:lhsmtool_posix.0 Request processed in 158us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391624.614580:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 52 00000100:00100000:3.0:1790391624.618452:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391624.618549:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169667456 00000100:00100000:2.0:1790391624.618560:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169667456 00000100:00100000:2.0:1790391624.618628:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:2.0:1790391624.618639:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+29:15655:x1877361169667456:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391624.618661:0:20339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391624.618685:0:20339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e281c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0663 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790391624.619110:0:20339:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1790391624.619117:0:20339:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1790391624.619151:0:20339:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1790391624.619306:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e2823 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.619322:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e2823 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.619333:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e2823 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.619387:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e281c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0663 expref: 32 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.619404:0:20339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e2823 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0663 expref: 31 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.619412:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6cf00) 00010000:00010000:2.0:1790391624.619415:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790391624.619418:0:20339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309dc00, rc 0) 00000100:00100000:2.0:1790391624.619488:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+31:15655:x1877361169667456:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 851us (1048us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1790391624.619496:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 53 00000100:00100000:2.0:1790391624.629170:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391624.629281:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169667712 00000100:00100000:0.0:1790391624.629291:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169667712 00000100:00100000:0.0:1790391624.629355:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:0.0:1790391624.629382:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+31:15655:x1877361169667712:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790391624.629442:0:17201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790391624.629468:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309dc00/0x2b1b7949f13e2823 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0663 expref: 31 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629488:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6cf00) 00010000:00010000:0.0:1790391624.629500:0:17201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790391624.629525:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2831 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629539:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2831 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629550:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2831 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629564:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2838 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa5f29ba6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629570:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2838 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5f29ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629577:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2838 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5f29ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629625:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2831 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629632:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2831 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629651:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2831 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629657:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391624.629661:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2831 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629669:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2831 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629677:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:0.0:1790391624.629680:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391624.629683:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2831 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629689:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145200/0x2b1b7949f13e2831 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629699:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2838 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5f29ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629704:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2838 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5f29ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629721:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2838 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5f29ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629726:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:0.0:1790391624.629728:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2838 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5f29ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629743:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2838 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa5f29ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629752:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa5f29ba6 (ffff9e51831af900) 00010000:00010000:0.0:1790391624.629754:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790391624.629756:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2838 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa5f29ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.629763:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145000/0x2b1b7949f13e2838 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa5f29ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391624.629859:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+30:15655:x1877361169667712:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 478us (700us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790391624.629870:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 54 00000100:00100000:3.0:1790391624.631724:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391624.631809:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169667840 00000100:00100000:2.0:1790391624.631828:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169667840 00000100:00100000:2.0:1790391624.631920:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:2.0:1790391624.631929:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+30:15655:x1877361169667840:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391624.631946:0:20339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391624.631966:0:20339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e283f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b066a expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.632011:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e2846 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.632022:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e2846 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.632032:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e2846 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.632135:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e283f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b066a expref: 32 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.632151:0:20339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309c800/0x2b1b7949f13e2846 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b066a expref: 31 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.632159:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391624.632162:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391624.632166:0:20339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309c800, rc 0) 00000100:00100000:2.0:1790391624.632215:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+31:15655:x1877361169667840:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 288us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391624.632221:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 55 00000100:00100000:1.0:1790391624.634825:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391624.634926:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169668096 00000100:00100000:0.0:1790391624.634936:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169668096 00000100:00100000:0.0:1790391624.634992:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:0.0:1790391624.635001:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5284945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+31:15655:x1877361169668096:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790391624.635080:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.635094:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.635106:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790391624.635283:0:17201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1790391624.635298:0:17201:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 538002420574ns, next at 539002417957ns, rc = 0 00000004:00010000:0.0:1790391624.635364:0:17201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c709a3b reply state 000000006dab71ec transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.635376:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.635383:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:0.0:1790391624.635386:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790391624.635390:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790391624.635478:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5284945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+33:15655:x1877361169668096:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 478us (669us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1790391624.635491:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 56 00000100:00100000:3.0:1790391624.637465:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391624.637537:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169668224 00000100:00100000:2.0:1790391624.637549:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169668224 00000100:00100000:2.0:1790391624.637604:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:2.0:1790391624.637615:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+33:15655:x1877361169668224:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391624.637636:0:20339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391624.637655:0:20339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2854 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0671 expref: -99 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.637719:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2854 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0671 expref: 34 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.637733:0:20339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2854 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0671 expref: 34 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.637750:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391624.637753:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790391624.637757:0:20339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309ce00, rc 0) 00000100:00100000:2.0:1790391624.637809:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+34:15655:x1877361169668224:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 196us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391624.638317:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 57 00000100:00100000:2.0:1790391624.640449:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391624.640528:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169668352 00000100:00100000:1.0:1790391624.640538:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169668352 00000100:00100000:1.0:1790391624.640635:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:1.0:1790391624.640645:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2384:x1877361169668352:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790391624.640870:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:2384:x1877361169668352:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 227us (432us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1790391624.640898:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 23 00000100:00100000:3.0:1790391624.643115:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391624.643248:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169668608 00000100:00100000:1.0:1790391624.643256:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169668608 00000100:00100000:1.0:1790391624.643305:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:1.0:1790391624.643315:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+34:15655:x1877361169668608:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790391624.643524:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+35:15655:x1877361169668608:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 209us (417us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1790391624.643532:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 9 00000100:00100000:2.0:1790391624.645537:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391624.645603:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169668864 00000100:00100000:0.0:1790391624.645612:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169668864 00000100:00100000:0.0:1790391624.645662:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00100000:0.0:1790391624.645670:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+35:15655:x1877361169668864:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790391624.645766:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+35:15655:x1877361169668864:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 96us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391624.645773:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 58 00000100:00100000:3.0:1790391624.648082:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391624.648269:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169668992 00000100:00100000:1.0:1790391624.648279:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169668992 00000100:00100000:1.0:1790391624.648337:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:1.0:1790391624.648349:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+35:15655:x1877361169668992:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790391624.648390:0:17203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391624.648413:0:17203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e285b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0678 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.648486:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e2862 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.648501:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e2862 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.648512:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e2862 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790391624.648561:0:17203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790391624.648581:0:17203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e2862 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.648606:0:17203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e285b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0678 expref: 37 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.648624:0:17203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e2862 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0678 expref: 36 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.648633:0:17203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391624.648636:0:17203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790391624.648639:0:17203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055800, rc 0) 00000100:00100000:1.0:1790391624.648699:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+36:15655:x1877361169668992:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 351us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391624.648706:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 59 00000100:00100000:1.0:1790391624.651267:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391624.651349:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169669120 00000100:00100000:2.0:1790391624.651359:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169669120 00000100:00100000:2.0:1790391624.651408:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:2.0:1790391624.651419:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5288346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:2384:x1877361169669120:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391624.651436:0:18707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391624.651456:0:18707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000069ea3cf/0x2b1b7949f13e2869 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b067f expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790391624.651481:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab73549, blocks: 0x0 00010000:00010000:2.0:1790391624.651497:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1790391624.651500:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391624.651518:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069ea3cf/0x2b1b7949f13e2869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b067f expref: 7 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.651534:0:18707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000069ea3cf/0x2b1b7949f13e2869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b067f expref: 7 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.651544:0:18707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d200, rc 0) 00000100:00100000:2.0:1790391624.651604:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5288346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:2384:x1877361169669120:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 186us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391624.651612:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 24 00000100:00100000:3.0:1790391624.653920:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391624.653992:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169669376 00000100:00100000:0.0:1790391624.653999:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169669376 00000100:00100000:0.0:1790391624.654046:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:0.0:1790391624.654053:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+36:15655:x1877361169669376:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790391624.654159:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+36:15655:x1877361169669376:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 106us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391624.654167:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 60 00000100:00100000:3.0:1790391624.656484:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391624.656577:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169669504 00000100:00100000:1.0:1790391624.656587:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169669504 00000100:00100000:1.0:1790391624.656645:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:1.0:1790391624.656654:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+36:15655:x1877361169669504:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790391624.658569:0:17182:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1790391624.658587:0:17182:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1790391624.658646:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790391624.658649:0:17182:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1790391624.658658:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.658666:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.658673:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183086800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391624.658679:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.658687:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.659464:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.659479:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.659487:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.659492:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309da00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391624.659496:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.659502:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.659523:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:3.0:1790391624.659525:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790391624.659529:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.659533:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e26f6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391624.659906:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186526080:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1790391624.660155:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e5283a48f00) 00010000:00010000:1.0:1790391624.660159:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391624.660165:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660171:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183086800/0x2b1b7949f13e26a2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660190:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660207:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660213:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660219:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5183087800 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391624.660222:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660240:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660249:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e5283a48900) 00010000:00010000:1.0:1790391624.660252:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391624.660255:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660260:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5183087800/0x2b1b7949f13e26a9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660276:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660282:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660288:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660298:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144a00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391624.660308:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660314:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660323:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e51831af800) 00010000:00010000:1.0:1790391624.660325:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391624.660328:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660333:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144a00/0x2b1b7949f13e2751 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660353:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660358:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660363:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660367:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9de00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391624.660370:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660375:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660382:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:1.0:1790391624.660384:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790391624.660393:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660399:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e52bab9de00/0x2b1b7949f13e27d6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660410:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660415:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660420:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660424:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:1.0:1790391624.660427:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660432:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660439:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391624.660441:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790391624.660444:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.660449:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144200/0x2b1b7949f13e284d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391624.660606:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391624.660701:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186526080 00000100:00100000:1.0:1790391624.660720:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186526080 00000100:00100000:1.0:1790391624.660770:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391624.660786:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186526080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790391624.661012:0:18708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790391624.661015:0:18708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790391624.661017:0:18708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790391624.661018:0:18708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790391625 -> 1790391625 00002000:00010000:1.0:1790391624.661020:0:18708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1790391624.661140:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e5183b7e680/2, rc 0, transno 8589934596 00000100:00100000:2.0:1790391624.661147:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186526080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790391624.661150:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+15:15655:x1877361169669504:12345-192.168.202.28@tcp:44:lhsmtool_posix.0 Request processed in 4494us (4676us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391624.661167:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 61 00000100:00100000:1.0:1790391624.661273:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1877361186526080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 489us (667us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790391624.661280:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790391624.663690:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391624.663778:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169669632 00000100:00100000:3.0:1790391624.663788:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169669632 00000100:00100000:3.0:1790391624.666941:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:3.0:1790391624.666966:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:2383:x1877361169669632:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790391624.667088:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183a41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:2383:x1877361169669632:12345-192.168.202.28@tcp:16:lhsmtool_posix.0 Request processed in 134us (3480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391624.667095:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 26 00000100:00100000:3.0:1790391624.669553:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391624.669703:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169669888 00000100:00100000:1.0:1790391624.669726:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169669888 00000100:00100000:1.0:1790391624.669784:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 62 00000100:00100000:1.0:1790391624.669793:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+15:15655:x1877361169669888:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790391624.669859:0:17201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391624.669913:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055800/0x2b1b7949f13e2862 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0678 expref: 15 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.669930:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391624.669936:0:17201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790391624.669966:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.669980:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.669989:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790391624.670114:0:17201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0e730a8 reply state 00000000c4cbcdf5 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.670142:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055c00/0x2b1b7949f13e2870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.670148:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:1.0:1790391624.670151:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790391624.670153:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790391624.670262:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+16:15655:x1877361169669888:12345-192.168.202.28@tcp:36:lhsmtool_posix.0 Request processed in 468us (718us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1790391624.670269:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 62 00000100:00100000:3.0:1790391624.672962:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391624.673065:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169670016 00000100:00100000:2.0:1790391624.673075:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169670016 00000100:00100000:2.0:1790391624.673129:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:2.0:1790391624.673140:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:15655:x1877361169670016:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790391624.673160:0:18709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790391624.673177:0:18709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b0686 expref: -99 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.673243:0:18709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000069ea3cf/0x2b1b7949f13e2869 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b067f expref: 8 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.673253:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391624.673257:0:18709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790391624.673262:0:18709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 8 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.673300:0:18709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000069ea3cf/0x2b1b7949f13e2869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b067f expref: 8 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.673314:0:18709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000069ea3cf/0x2b1b7949f13e2869 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b067f expref: 8 pid: 18707 timeout: 638 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391624.673328:0:18709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18709:1877361186526208:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391624.673411:0:18709:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d4480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391624.676982:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391624.677075:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169670144 00000100:00100000:1.0:1790391624.677085:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169670144 00010000:00010000:1.0:1790391624.677126:0:17188:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000069ea3cf/0x2b1b7949f13e2869 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b067f expref: 9 pid: 18707 timeout: 638 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391624.677161:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:1.0:1790391624.677170:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+9:2383:x1877361169670144:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790391624.677187:0:17188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790391624.677206:0:17188:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000069ea3cf/0x2b1b7949f13e2869 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b067f expref: 9 pid: 18707 timeout: 638 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.677220:0:17188:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000069ea3cf/0x2b1b7949f13e2869 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b067f expref: 9 pid: 18707 timeout: 638 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.677255:0:17188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391624.677260:0:17188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391624.677268:0:17188:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 9 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.677290:0:17188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 9 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.677339:0:17188:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 9 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391624.677356:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17188:1877361186526336:192.168.202.28@tcp:105: 00000100:00100000:1.0:1790391624.677461:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae89ed80 going to sleep for 11 seconds 00010000:00010000:2.0:1790391624.677764:0:18709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000069ea3cf/0x2b1b7949f13e2869 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b067f expref: 9 pid: 18707 timeout: 638 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391624.677780:0:18709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18709:1877361186526208:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391624.677817:0:18709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 8 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.677841:0:18709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e518309d400, rc 0) 00000100:00100000:2.0:1790391624.677871:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+8:15655:x1877361169670016:12345-192.168.202.28@tcp:101:lhsmtool_posix.0 Request processed in 4733us (4920us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391624.677916:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 27 00000100:00100000:1.0:1790391624.685324:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17188:1877361186526336:192.168.202.28@tcp:105: 00010000:00010000:1.0:1790391624.685356:0:17188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790391624.685416:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:2383:x1877361169670144:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 8245us (8445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391624.685428:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 19 00000100:00100000:0.0:1790391624.701921:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391624.702044:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169670272 00000100:00100000:3.0:1790391624.702054:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169670272 00000100:00100000:3.0:1790391624.702109:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:3.0:1790391624.702119:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:2383:x1877361169670272:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790391624.702276:0:18707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790391624.702279:0:18707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1790391624 00002000:00010000:3.0:1790391624.702283:0:18707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1790391623 00002000:00010000:3.0:1790391624.702285:0:18707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790391625 -> 1790391624 00002000:00010000:3.0:1790391624.702287:0:18707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790391624.702372:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+8:2383:x1877361169670272:12345-192.168.202.28@tcp:2:lhsmtool_posix.0 Request processed in 254us (506us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1790391624.702380:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 28 00000100:00100000:0.0:1790391624.705161:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391624.705283:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169670400 00000100:00100000:1.0:1790391624.705303:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169670400 00000100:00100000:1.0:1790391624.705361:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:1.0:1790391624.705370:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+8:2384:x1877361169670400:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790391624.705416:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.705439:0:18708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 8 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.705449:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790391624.705469:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790391624.705474:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.705510:0:18708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 8 pid: 18709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.705525:0:18708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 8 pid: 18709 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391624.705541:0:18708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18708:1877361186526464:192.168.202.28@tcp:104: 00000100:00100000:1.0:1790391624.705631:0:18708:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae89ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1790391624.708218:0:18708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18708:1877361186526464:192.168.202.28@tcp:104: 00010000:00010000:1.0:1790391624.708259:0:18708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391624.709652:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391624.709751:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169670528 00000100:00100000:3.0:1790391624.709761:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169670528 00010000:00010000:3.0:1790391624.709803:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 9 pid: 18709 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391624.709855:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 20 00000100:00100000:3.0:1790391624.709865:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+9:2384:x1877361169670528:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391624.709916:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391624.709938:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 9 pid: 18709 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.709953:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 9 pid: 18709 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.709975:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046c22b50/0x2b1b7949f13e2877 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0686 expref: 9 pid: 18709 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.709991:0:17189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391624.709996:0:17189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790391624.710002:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.710012:0:17189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.710285:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391624.710459:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89b7dd42-ca89-4c21-9061-6e0347f78f2b+8:2384:x1877361169670528:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 592us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391624.710467:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 20 00010000:00010000:1.0:1790391624.713487:0:18708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.713512:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.713551:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.713560:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.713590:0:18708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.713597:0:18708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5184055800 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:1.0:1790391624.713602:0:18708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.713613:0:18708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.713633:0:18708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.713641:0:18708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0701ec4/0x2b1b7949f13e287e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790391624.714203:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+7:2384:x1877361169670400:12345-192.168.202.28@tcp:1:lhsmtool_posix.0 Request processed in 8827us (9048us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391624.714213:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 29 00000100:00100000:0.0:1790391624.718569:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391624.718670:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169670784 00000100:00100000:2.0:1790391624.718682:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169670784 00000100:00100000:2.0:1790391624.718764:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 63 00000100:00100000:2.0:1790391624.718775:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+16:15655:x1877361169670784:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790391624.718906:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.718924:0:20339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0647 expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.718933:0:20339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.718974:0:20339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0647 expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.718988:0:20339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0647 expref: 16 pid: 17201 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391624.719021:0:20339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20339:1877361186526592:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391624.719094:0:20339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e52ae9d4480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391624.724307:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:3.0:1790391624.724448:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169670912 00000100:00100000:3.0:1790391624.724459:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169670912 00010000:00010000:3.0:1790391624.724499:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0647 expref: 17 pid: 17201 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790391624.724544:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 21 00000100:00100000:3.0:1790391624.724556:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+17:2384:x1877361169670912:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790391624.724571:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790391624.724577:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0647 expref: 17 pid: 17201 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.724590:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0647 expref: 17 pid: 17201 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.724611:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:3.0:1790391624.724617:0:17187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0655 expref: 17 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.724628:0:17187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.724636:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.724644:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.724682:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790391624.724750:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+17:2384:x1877361169670912:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 197us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391624.724758:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 21 00010000:00010000:2.0:1790391624.725280:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295145600/0x2b1b7949f13e27cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0647 expref: 16 pid: 17201 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391624.725296:0:20339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20339:1877361186526592:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391624.725319:0:20339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.725328:0:20339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.725338:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.725535:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.725547:0:20339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2854 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0671 expref: 16 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.725555:0:20339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.725583:0:20339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2854 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0671 expref: 16 pid: 20339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.725596:0:20339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2854 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0671 expref: 16 pid: 20339 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391624.725614:0:20339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20339:1877361186526720:192.168.202.28@tcp:104: 00000100:00100000:2.0:1790391624.725688:0:20339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb4000 going to sleep for 11 seconds 00000100:00100000:2.0:1790391624.729179:0:20339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20339:1877361186526720:192.168.202.28@tcp:104: 00010000:00010000:2.0:1790391624.729213:0:20339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391624.731222:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391624.731325:0:20226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169671040 00000100:00100000:2.0:1790391624.731334:0:20226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169671040 00010000:00010000:2.0:1790391624.731372:0:20226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2854 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0671 expref: 17 pid: 20339 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391624.731413:0:20226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 22 00000100:00100000:2.0:1790391624.731423:0:20226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+17:2384:x1877361169671040:12345-192.168.202.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790391624.731437:0:20226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790391624.731444:0:20226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2854 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0671 expref: 17 pid: 20339 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.731457:0:20226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2854 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0671 expref: 17 pid: 20339 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.731482:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2854 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0671 expref: 17 pid: 20339 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.731497:0:20226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:2.0:1790391624.731503:0:20226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.731525:0:20226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.731532:0:20226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.731563:0:20226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790391624.731626:0:20226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+16:2384:x1877361169671040:12345-192.168.202.28@tcp:103:ldlm_bl.0 Request processed in 204us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391624.731634:0:20226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 22 00010000:00010000:3.0:1790391624.731918:0:20339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.731928:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790391624.732058:0:20339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1790391624.732171:0:20339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1790391624.732215:0:20339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1790391624.732305:0:20339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20339:1877361186526848:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790391624.732354:0:20339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391624.732379:0:20339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1790391624.732576:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186526848 00000100:00100000:2.0:1790391624.732583:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186526848 00000100:00100000:2.0:1790391624.732626:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391624.732634:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20339:x1877361186526848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790391624.732735:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20339:x1877361186526848:12345-0@lo:1000:mdt00_003.0 Request processed in 102us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391624.732742:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790391624.732989:0:20339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20339:1877361186526848:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1790391624.733126:0:20339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1790391624.733170:0:20339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183baad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20339:1877361186526976:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790391624.733200:0:20339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790391624.733215:0:20339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e51823da480 going to sleep for 11 seconds 00000100:00100000:0.0:1790391624.733309:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186526976 00000100:00100000:0.0:1790391624.733314:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186526976 00000100:00100000:0.0:1790391624.733346:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790391624.733354:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20339:x1877361186526976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790391624.733465:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:20339:x1877361186526976:12345-0@lo:1000:mdt00_003.0 Request processed in 112us (263us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1790391624.733473:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790391624.733826:0:20339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183baad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20339:1877361186526976:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1790391624.733864:0:20339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.733873:0:20339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734097:0:20339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734104:0:20339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309da00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391624.734109:0:20339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734117:0:20339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734131:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:3.0:1790391624.734134:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391624.734139:0:20339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734145:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309da00/0x2b1b7949f13e288c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734175:0:20339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734182:0:20339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734188:0:20339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734192:0:20339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295144000 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:3.0:1790391624.734195:0:20339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734210:0:20339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734218:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:3.0:1790391624.734221:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790391624.734227:0:20339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0655 expref: 19 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734253:0:20339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27eb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0655 expref: 19 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.734261:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0655 expref: 19 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.734451:0:20339:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144c00/0x2b1b7949f13e27eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b0655 expref: 19 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391624.734464:0:20339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20339:1877361186527104:192.168.202.28@tcp:105: 00000100:00100000:2.0:1790391624.734529:0:20339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e5282bb4000 going to sleep for 11 seconds 00000100:00100000:0.0:1790391624.739619:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:1.0:1790391624.739693:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169671168 00000100:00100000:1.0:1790391624.739703:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169671168 00000100:00100000:1.0:1790391624.739774:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:1.0:1790391624.739784:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52954d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+20:15653:x1877361169671168:12345-192.168.202.28@tcp:49:dd.0 00000100:00100000:1.0:1790391624.739947:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52954d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+20:15653:x1877361169671168:12345-192.168.202.28@tcp:49:dd.0 Request processed in 164us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391624.739967:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 10 00000100:00100000:2.0:1790391624.740305:0:20339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20339:1877361186527104:192.168.202.28@tcp:105: 00010000:00010000:2.0:1790391624.740333:0:20339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740342:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5295144000/0x2b1b7949f13e27e4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740380:0:20339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2893 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740394:0:20339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2893 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740406:0:20339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2893 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740416:0:20339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2893 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740421:0:20339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2893 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740427:0:20339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2893 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740432:0:20339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309ce00 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391624.740436:0:20339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2893 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740443:0:20339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2893 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740453:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:2.0:1790391624.740457:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790391624.740460:0:20339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2893 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740465:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309ce00/0x2b1b7949f13e2893 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740483:0:20339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740489:0:20339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740495:0:20339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740500:0:20339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d200 already unused, calling callback (ffffffffc185e4f0) 00010000:00010000:2.0:1790391624.740503:0:20339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740509:0:20339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740517:0:20339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:2.0:1790391624.740519:0:20339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790391624.740522:0:20339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.740528:0:20339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e2885 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790391624.740665:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89b7dd42-ca89-4c21-9061-6e0347f78f2b+19:15655:x1877361169670784:12345-192.168.202.28@tcp:57:lhsmtool_posix.0 Request processed in 21891us (22110us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1790391624.740673:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 63 00000020:00080000:2.0:1790391624.740678:0:20339:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790391624.741101:0:17237:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790391624.741106:0:17237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790391624.741123:0:17237:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790391624.741130:0:17237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790391624.748494:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391624.748545:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391624.748641:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169671552 00000100:00100000:2.0:1790391624.748651:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169671552 00000100:00100000:2.0:1790391624.748734:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 11 00000100:00100000:2.0:1790391624.748745:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+19:15655:x1877361169671552:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790391624.749067:0:17205:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790391624.749100:0:17205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1790391624.749150:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.749167:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.749178:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.749186:0:17205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.749192:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.749199:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790391624.749215:0:17205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790391624.749307:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+21:15655:x1877361169671552:12345-192.168.202.28@tcp:35:lhsmtool_posix.0 Request processed in 564us (759us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1790391624.749315:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 11 00000020:00080000:2.0:1790391624.749320:0:17205:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790391624.749508:0:17191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790391624.749515:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.749523:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e518309d200 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391624.749527:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.749535:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.749567:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e52b9b6c200) 00010000:00010000:0.0:1790391624.749570:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790391624.749576:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.749582:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e518309d200/0x2b1b7949f13e289a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.749593:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391624.749595:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790391624.749596:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391624.750155:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169671296 00000100:00100000:1.0:1790391624.750164:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169671296 00000100:00100000:1.0:1790391624.750210:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:1.0:1790391624.750220:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+21:15653:x1877361169671296:12345-192.168.202.28@tcp:101:dd.0 00010000:00010000:1.0:1790391624.750246:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790391624.750260:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e28a1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xeddc9396a49b068d expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.750306:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055600/0x2b1b7949f13e28a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.750317:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055600/0x2b1b7949f13e28a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.750326:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055600/0x2b1b7949f13e28a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.750415:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055400/0x2b1b7949f13e28a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b068d expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.750432:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e5184055600/0x2b1b7949f13e28a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.28@tcp remote: 0xeddc9396a49b068d expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790391624.750452:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e51831af600) 00010000:00010000:1.0:1790391624.750455:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790391624.750458:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e5184055600, rc 0) 00000100:00100000:1.0:1790391624.750511:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89b7dd42-ca89-4c21-9061-6e0347f78f2b+22:15653:x1877361169671296:12345-192.168.202.28@tcp:101:dd.0 Request processed in 292us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391624.750518:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 64 00000100:00100000:0.0:1790391624.918273:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:0.0:1790391624.918326:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.28@tcp (source: 12345-192.168.202.28@tcp) 00000100:00100000:2.0:1790391624.918436:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169671808 00000100:00100000:2.0:1790391624.918449:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169671808 00000100:00100000:2.0:1790391624.918521:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361169671680 00000100:00100000:2.0:1790391624.918525:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361169671680 00000100:00100000:3.0:1790391624.918564:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:3.0:1790391624.918576:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+8:2382:x1877361169671808:12345-192.168.202.28@tcp:4:dd.0 00002000:00010000:3.0:1790391624.918641:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6ab73548, atime: 0x6ab73547, ctime: 0x6ab73548, blocks: 0x0 00010000:00010000:3.0:1790391624.918650:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4126aa5/0x2b1b7949f13e28af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.918667:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1790391624.918671:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790391624.918678:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4126aa5/0x2b1b7949f13e28af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790391624.918692:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4126aa5/0x2b1b7949f13e28af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391624.996640:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1790391624.996668:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1790391624.997289:0:18713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1790391624.997294:0:18713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1790391624 -> 1790391625 00002000:00010000:0.0:1790391624.997297:0:18713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790391624 -> 1790391625 00002000:00010000:0.0:1790391624.997300:0:18713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1790391624.997326:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4126aa5/0x2b1b7949f13e28af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.997340:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4126aa5/0x2b1b7949f13e28af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.997350:0:18713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4126aa5/0x2b1b7949f13e28af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.997357:0:18713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e52bab9d000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391624.997362:0:18713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4126aa5/0x2b1b7949f13e28af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.997458:0:18713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4126aa5/0x2b1b7949f13e28af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.997478:0:18713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4126aa5/0x2b1b7949f13e28af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.997485:0:18713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4126aa5/0x2b1b7949f13e28af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391624.997646:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+6:2382:x1877361169671808:12345-192.168.202.28@tcp:4:dd.0 Request processed in 79066us (79381us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790391624.997662:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 0 00000100:00100000:0.0:1790391624.997695:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.28@tcp, seq: 1 00000100:00100000:0.0:1790391624.997707:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169671680:12345-192.168.202.28@tcp:4:dd.0 00002000:00010000:0.0:1790391624.997744:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6ab73549, atime: 0x6ab73547, ctime: 0x6ab73549, blocks: 0x1a68 00010000:00010000:0.0:1790391624.997750:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e28b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.997760:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1790391624.997765:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790391624.997772:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e28b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391624.997783:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e28b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790391625.078028:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1790391625.085062:0:18713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1790391625.085091:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e28b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391625.085106:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e28b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391625.085116:0:18713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e28b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391625.085123:0:18713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e5295145000 already unused, calling callback (ffffffffc0c654f0) 00010000:00010000:0.0:1790391625.085128:0:18713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e28b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391625.085138:0:18713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e28b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391625.085162:0:18713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e28b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790391625.085171:0:18713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b29dda3c/0x2b1b7949f13e28b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790391625.085313:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e51831dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:89b7dd42-ca89-4c21-9061-6e0347f78f2b+5:2382:x1877361169671680:12345-192.168.202.28@tcp:4:dd.0 Request processed in 87604us (166980us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790391625.085332:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.28@tcp, seq: 1 00010000:00010000:0.0:1790391625.227398:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790391626.248314:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186527232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790391626.248382:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391626.248435:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186527232 00000100:00100000:1.0:1790391626.248443:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186527232 00000100:00100000:1.0:1790391626.248493:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790391626.248503:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186527232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790391626.248530:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790391626.248567:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877361186527232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391626.248574:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790391626.248592:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790391626.248626:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e52bf948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1877361186527232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790391626.248928:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186527488:0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.248959:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391626.248977:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186528000:0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.248995:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391626.249009:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186528512:0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249029:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391626.249044:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790391626.249048:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186527360:0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249070:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391626.249091:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186527872:0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249109:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391626.249121:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186528384:0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249137:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790391626.249159:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186527488 00000100:00100000:2.0:1790391626.249162:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186527488 00000100:00100000:2.0:1790391626.249185:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186528000 00000100:00100000:2.0:1790391626.249187:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186528000 00000100:00100000:2.0:1790391626.249200:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391626.249205:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186527488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249255:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186527488:12345-0@lo:400:kworker.0 Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391626.249262:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391626.249274:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790391626.249279:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186528000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249301:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877361186528000:12345-0@lo:400:kworker.0 Request processed in 22us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391626.249321:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790391626.249344:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186527360 00000100:00100000:2.0:1790391626.249347:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186527360 00000100:00100000:2.0:1790391626.249367:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790391626.249372:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52b7675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3638:x1877361186527360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249404:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52b7675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f157595d-6a80-4a0f-be35-35ee7e9fe29d+24:3638:x1877361186527360:12345-0@lo:400:kworker.0 Request processed in 30us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391626.249410:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790391626.249436:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186528512 00000100:00100000:2.0:1790391626.249440:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186528512 00000100:00100000:2.0:1790391626.249470:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186527872 00000100:00100000:2.0:1790391626.249473:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186527872 00000100:00100000:3.0:1790391626.249475:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186528384 00000100:00100000:3.0:1790391626.249482:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186528384 00000100:00100000:2.0:1790391626.249487:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391626.249495:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186528512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790391626.249515:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790391626.249529:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877361186528512:12345-0@lo:400:kworker.0 Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391626.249530:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518382a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186527872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249542:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790391626.249555:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391626.249562:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186528384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249585:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877361186528384:12345-0@lo:400:kworker.0 Request processed in 24us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790391626.249591:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790391626.249618:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183a42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f157595d-6a80-4a0f-be35-35ee7e9fe29d:3638:1877361186527360:0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249630:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1877361186528384:0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249638:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186527488:0@lo:400:kworker.0 00000100:00100000:2.0:1790391626.249653:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1877361186528000:0@lo:400:kworker.0 00010000:00080000:2.0:1790391626.249663:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e518382bb80 x1877361186528512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790391626.249673:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1877361186528512:0@lo:400:kworker.0 00010000:00010000:2.0:1790391626.249723:0:17191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790391626.250387:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518382a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877361186527872:12345-0@lo:400:kworker.0 Request processed in 770us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790391626.250398:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790391626.250435:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877361186527872:0@lo:400:kworker.0 00000100:00100000:3.0:1790391626.250445:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790391626.250452:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186528896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790391626.250482:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391626.250637:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186527616:0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.250667:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391626.250685:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186528128:0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.250714:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391626.250729:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186528640:0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.250745:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391626.250761:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790391626.250767:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186527744:0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.250783:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391626.250796:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e518382b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186528256:0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.250813:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391626.250826:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186528768:0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.250841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790391626.250863:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186527616 00000100:00100000:1.0:1790391626.250868:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186527616 00000100:00100000:1.0:1790391626.251354:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186528128 00000100:00100000:1.0:1790391626.251359:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186528128 00000100:00100000:1.0:1790391626.251374:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186527744 00000100:00100000:1.0:1790391626.251376:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186527744 00000100:00100000:1.0:1790391626.251389:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391626.251395:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186527616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.251437:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186527616:12345-0@lo:400:kworker.0 Request processed in 42us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391626.251444:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391626.251455:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391626.251460:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bf949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186528128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.251481:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bf949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877361186528128:12345-0@lo:400:kworker.0 Request processed in 21us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391626.251487:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790391626.251502:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391626.251508:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186527744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.251531:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e518229e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877361186527744:12345-0@lo:400:kworker.0 Request processed in 24us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391626.251537:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790391626.251554:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186528640 00000100:00100000:1.0:1790391626.251557:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186528640 00000100:00100000:1.0:1790391626.251575:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186528256 00000100:00100000:1.0:1790391626.251577:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186528256 00000100:00100000:1.0:1790391626.251586:0:20339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186528768 00000100:00100000:1.0:1790391626.251588:0:20339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186528768 00000100:00100000:1.0:1790391626.251598:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790391626.251604:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e52bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186528640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.251632:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e52bfb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877361186528640:12345-0@lo:400:kworker.0 Request processed in 28us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391626.251638:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790391626.251648:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790391626.251654:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186528256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.251676:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877361186528256:12345-0@lo:400:kworker.0 Request processed in 22us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391626.251681:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790391626.251690:0:20339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790391626.251695:0:20339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186528768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.251716:0:20339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877361186528768:12345-0@lo:400:kworker.0 Request processed in 20us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1790391626.251721:0:20339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1790391626.251743:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790391626.251751:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790391626.251754:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790391626.251756:0:17198:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790391626.251780:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186527744:0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.251789:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877361186528256:0@lo:400:kworker.0 00010000:00080000:1.0:1790391626.251800:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e5183828e00 x1877361186528768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790391642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790391626.251809:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1877361186528768:0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.251817:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1790391626.251821:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e5183b7e680, transno 8589934596 00000004:00080000:1.0:1790391626.251832:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1790391626.251848:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1877361186527616:0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.251859:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e518382a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1877361186528128:0@lo:400:kworker.0 00000100:00100000:1.0:1790391626.251868:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5183828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1877361186528640:0@lo:400:kworker.0 00000100:00100000:0.0:1790391626.255830:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877361186528896 00000100:00100000:0.0:1790391626.255848:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877361186528896 00000100:00100000:0.0:1790391626.255926:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790391626.255938:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5183ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186528896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790391626.255963:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790391626.256058:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5183ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877361186528896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (5574us total) trans 0 rc 0/0 00000100:00100000:0.0:1790391626.256076:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790391626.258366:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e51831dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1877361186528896:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1790391626.537401:0:20377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1790391627.277764:0:17190:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42880 lines, 42880 kept, 0 dropped, 0 bad.